Jul 07 09:04:23 devstack cinder-volume[75680]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 09:04:23 devstack cinder-volume[75680]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 09:04:23 devstack cinder-volume[75680]: we strongly recommend against using it for new projects. Jul 07 09:04:23 devstack cinder-volume[75680]: If you are already using Eventlet, we recommend migrating to a different Jul 07 09:04:23 devstack cinder-volume[75680]: framework. For more detail see Jul 07 09:04:23 devstack cinder-volume[75680]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 09:04:23 devstack cinder-volume[75680]: import eventlet # noqa Jul 07 09:04:26 devstack cinder-volume[75680]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:04:26 devstack cinder-volume[75680]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:04:26 devstack cinder-volume[75680]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:04:26 devstack cinder-volume[75680]: INFO dbcounter [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Registered counter for database cinder Jul 07 09:04:26 devstack cinder-volume[75680]: DEBUG oslo_db.sqlalchemy.engines [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:04:27 devstack cinder-volume[75680]: DEBUG dbcounter [-] [75680] Writer thread running {{(pid=75680) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 09:04:27 devstack cinder-volume[75680]: INFO cinder.rpc [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 09:04:27 devstack cinder-volume[75680]: INFO cinder.rpc [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 09:04:27 devstack cinder-volume[75680]: DEBUG oslo_db.sqlalchemy.engines [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:04:27 devstack cinder-volume[75680]: INFO cinder.volume.manager [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Determined volume DB was empty at startup. Jul 07 09:04:27 devstack cinder-volume[75680]: DEBUG cinder.volume.manager [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75680) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 09:04:27 devstack cinder-volume[75680]: INFO cinder.volume.manager [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 09:04:27 devstack cinder-volume[75680]: WARNING stevedore.named [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 09:04:27 devstack cinder-volume[75680]: WARNING castellan.key_manager [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:04:27 devstack cinder-volume[75680]: WARNING cinder.keymgr.conf_key_mgr [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:04:27 devstack cinder-volume[75680]: DEBUG cinder.volume.drivers.lvm [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75680) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 07 09:04:27 devstack cinder-volume[75680]: DEBUG oslo_concurrency.processutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75680) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_concurrency.processutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.576s {{(pid=75680) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_db.sqlalchemy.engines [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:04:28 devstack cinder-volume[75680]: INFO cinder.rpc [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 07 09:04:28 devstack cinder-volume[75680]: INFO cinder.rpc [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 07 09:04:28 devstack cinder-volume[75680]: WARNING stevedore.named [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 09:04:28 devstack cinder-volume[75680]: WARNING castellan.key_manager [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:04:28 devstack cinder-volume[75680]: INFO cinder.volume.manager [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_db.sqlalchemy.engines [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75680) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:04:28 devstack cinder-volume[75680]: INFO oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Starting 1 workers Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Started child 75852 {{(pid=75680) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Full set of CONF: {{(pid=75680) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] ******************************************************************************** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Configuration options gathered from: {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] ================================================================================ {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] allow_availability_zone_fallback = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] allow_compression_on_image_upload = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] allowed_direct_url_schemes = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] api_rate_limit = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] auth_strategy = keystone {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] az_cache_duration = 3600 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_availability_zone = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_host = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75852]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_stats_polling_interval = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backup_api_class = cinder.backup.api.API {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backup_name_template = backup-%s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backup_use_same_host = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backup_use_temp_snapshot = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] chap_password = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] chap_username = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_internal_tenant_project_id = cb56127c81294d75a617affc69ee5710 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_internal_tenant_user_id = 4317ca9ff14d496eab4f2a8c130240d6 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cloned_volume_same_az = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cluster = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] compression_format = gzip {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] config_dir = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] config_source = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] control_exchange = openstack {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] debug = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] default_availability_zone = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] default_group_type = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] default_volume_type = lvmdriver-1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] disk_geometry = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] driver_client_cert = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] driver_client_cert_key = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] driver_data_namespace = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] driver_ssl_cert_path = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] driver_ssl_cert_verify = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] driver_use_ssl = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] enable_force_upload = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] enable_new_services = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] enable_unsupported_driver = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] enforce_multipath_for_image_xfer = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] filter_function = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_api_insecure = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_api_ssl_compression = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_ca_certificates_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_num_retries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance_request_timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] goodness_function = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] graceful_shutdown_timeout = 5 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] group_api_class = cinder.group.api.API {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] host = devstack {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_compress_on_upload = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_conversion_address_space_limit = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_conversion_cpu_limit = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_conversion_disable = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_upload_use_cinder_backend = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_upload_use_internal_tenant = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_volume_cache_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_volume_cache_max_count = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] init_host_max_objects_retrieval = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] instance_format = [instance: %(uuid)s] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] iscsi_target_flags = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] iscsi_write_cache = on {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] iser_helper = tgtadm {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] iser_ip_address = 192.168.122.170 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] iser_port = 3260 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_color = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_config_append = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_dir = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_options = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_rotate_interval = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_rotate_interval_type = days {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] log_rotation_type = none {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack sudo[75857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] max_age = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] max_logfile_count = 30 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] max_logfile_size_mb = 200 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] max_over_subscription_ratio = 20.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] message_reap_interval = 86400 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] message_ttl = 2592000 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack sudo[75857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] monkey_patch = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] monkey_patch_modules = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] my_ip = 192.168.122.170 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] no_snapshot_gb_quota = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] num_iser_scan_tries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] num_shell_tries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] num_volume_device_scan_tries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] nvmeof_conn_info_version = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] nvmet_ns_id = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] nvmet_port_id = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_max_limit = 1000 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_volume_ext_list = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_volume_listen_port = 8776 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_volume_use_ssl = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] osapi_volume_workers = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] per_volume_size_limit = -1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] periodic_fuzzy_delay = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] periodic_interval = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75852]: INFO cinder.volume.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] public_endpoint = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] publish_errors = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_backup_gigabytes = 1000 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_backups = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_gigabytes = 1000 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_groups = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_snapshots = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] quota_volumes = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] rate_limit_burst = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] rate_limit_except_level = CRITICAL {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] rate_limit_interval = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] reinit_driver_count = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] replication_device = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] report_discard_supported = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] report_interval = 120 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] reservation_clean_interval = 86400 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] reservation_expire = 86400 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] reserved_image_namespaces = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] reserved_percentage = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] rpc_response_timeout = 120 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] run_external_periodic_tasks = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] scst_target_driver = iscsi {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] scst_target_iqn_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_down_time = 720 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] shell_completion = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] snapshot_name_template = snapshot-%s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] snapshot_same_host = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] split_loggers = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] state_path = /opt/stack/data/cinder {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] storage_availability_zone = nova {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] storage_protocol = iSCSI {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] syslog_log_facility = LOG_USER {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] target_helper = lioadm {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] target_ip_address = 192.168.122.170 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] target_port = 3260 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] target_protocol = iscsi {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] target_secondary_ip_addresses = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] trace_flags = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] transport_url = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] until_refresh = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_chap_auth = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_default_quota_class = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_journal = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_json = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_multipath_for_image_xfer = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_stderr = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] use_syslog = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] verify_glance_signatures = enabled {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_api_class = cinder.volume.api.API {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_backend_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_clear = zero {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_clear_ionice = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_clear_size = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_copy_bps_limit = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_dd_blocksize = 1M {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_name_template = volume-%s {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_service_inithost_offload = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volume_usage_audit_period = month {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] zoning_mode = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.auth_section = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.auth_type = password {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.auth_version = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.cache = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.insecure = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.interface = public {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_password = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcache_username = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.region_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.service_type = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.170/identity {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.backend = dogpile.cache.null {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.backend_argument = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.backend_expiration_time = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.config_prefix = cache.oslo {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.debug_cache_backend = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.enable_retry_client = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.enable_socket_keepalive = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.expiration_time = 600 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_dead_retry = 300 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_sasl_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.042s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.password = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.proxies = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.redis_db = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.redis_server = localhost:6379 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.retry_attempts = 2 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.retry_delay = 0.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.socket_keepalive_count = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.socket_keepalive_idle = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.socket_keepalive_interval = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.socket_timeout = 1.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.tls_allowed_ciphers = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.tls_cafile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.tls_certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.tls_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.tls_keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cache.username = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] coordination.backend_url = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.asyncio_connection = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.asyncio_slave_connection = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.backend = sqlalchemy {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.connection = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.connection_debug = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.connection_parameters = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.connection_recycle_time = 3600 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.connection_trace = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.db_inc_retry_interval = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.db_max_retries = 20 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.db_max_retry_interval = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.db_retry_interval = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.max_overflow = 50 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.max_pool_size = 5 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.max_retries = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.pool_timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.retry_interval = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.slave_connection = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.sqlite_synchronous = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.synchronous_reader = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] database.use_db_reconnect = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.connection_string = messaging:// {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.es_doc_type = notification {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.es_scroll_size = 10000 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.es_scroll_time = 2m {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.filter_error_trace = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.hmac_keys = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.sentinel_service_name = mymaster {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.socket_timeout = 0.1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.trace_requests = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler.trace_sqlalchemy = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler_jaeger.process_tags = {} {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] profiler_otlp.service_name_prefix = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.enforce_scope = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.policy_default_rule = default {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.group = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.helper_command = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] privsep_osbrick.user = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.group = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.helper_command = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] cinder_sys_admin.user = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.auth_section = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.auth_type = password {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.cafile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.collect_timing = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.insecure = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.send_service_user_token = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.split_loggers = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] service_user.timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.auth_section = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.auth_type = password {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.collect_timing = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.insecure = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.region_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.split_loggers = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] glance.timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.backend_availability_zone = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.chap_password = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.chap_username = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.disk_geometry = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.driver_client_cert = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.driver_data_namespace = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.driver_use_ssl = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.extra_capabilities = {} {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.filter_function = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.goodness_function = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.053s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.iscsi_target_flags = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.iser_port = 3260 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.lvm_share_target = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.lvm_type = auto {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.replication_device = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.report_discard_supported = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.target_helper = tgtadm {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.target_port = 3260 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.target_protocol = iscsi {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.trace_flags = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.use_chap_auth = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_backend_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_clear = zero {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_reports.file_event_handler = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_reports.log_dir = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.backend_host = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.chap_password = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.chap_username = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.disk_geometry = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.filter_function = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.goodness_function = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.iser_helper = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.iser_port = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.lvm_type = auto {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.replication_device = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.storage_protocol = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.target_ip_address = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.target_port = 3260 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.trace_flags = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_clear = zero {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] lvmdriver-1.volumes_dir = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_notifications.driver = [] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] key_manager.fixed_key = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.barbican_api_version = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.barbican_endpoint = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.barbican_endpoint_type = public {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.barbican_region_name = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.cafile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.collect_timing = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.insecure = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.number_of_retries = 60 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.retry_delay = 1 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.send_service_user_token = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.split_loggers = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.verify_ssl = True {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican.verify_ssl_path = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.auth_section = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.auth_type = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.cafile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.certfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.collect_timing = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.insecure = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.keyfile = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.split_loggers = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] barbican_service_user.timeout = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.approle_role_id = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.approle_secret_id = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.kv_mountpoint = secret {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.kv_path = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.kv_version = 2 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.namespace = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.root_token_id = **** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.ssl_ca_crt_file = None {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.timeout = 60.0 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.use_ssl = False {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:04:28 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] ******************************************************************************** {{(pid=75680) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 09:04:29 devstack sudo[75857]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.749s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:29 devstack sudo[75941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:29 devstack sudo[75941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:29 devstack sudo[75941]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.665s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:04:29 devstack cinder-volume[75852]: INFO cinder.brick.local_dev.lvm [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:29 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:29 devstack sudo[76179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:04:29 devstack sudo[76179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:30 devstack sudo[76179]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:30 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.670s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:30 devstack cinder-volume[75852]: DEBUG cinder.brick.local_dev.lvm [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75852) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 07 09:04:30 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:30 devstack sudo[76383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:30 devstack sudo[76383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:32 devstack sudo[76383]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.462s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:32 devstack sudo[76601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:32 devstack sudo[76601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:32 devstack sudo[76601]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.821s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:32 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:32 devstack sudo[76639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 07 09:04:32 devstack sudo[76639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:33 devstack sudo[76639]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:33 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.685s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:33 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:33 devstack sudo[76643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:04:33 devstack sudo[76643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:34 devstack sudo[76643]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:34 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.863s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:34 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:34 devstack sudo[76654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:04:34 devstack sudo[76654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:35 devstack sudo[76654]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:35 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.739s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:35 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:35 devstack sudo[76659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:35 devstack sudo[76659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:36 devstack sudo[76659]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:36 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.799s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:36 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:36 devstack sudo[76665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:36 devstack sudo[76665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:36 devstack sudo[76665]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:36 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.735s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:36 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:36 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:36 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:36 devstack sudo[76673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:36 devstack sudo[76673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:37 devstack sudo[76673]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:37 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.735s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:37 devstack cinder-volume[75852]: INFO cinder.volume.drivers.lvm [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 07 09:04:37 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:37 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:37 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:37 devstack sudo[76683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:37 devstack sudo[76683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:38 devstack sudo[76683]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:38 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:38 devstack cinder-volume[75852]: DEBUG cinder.volume.drivers.lvm [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Updating volume stats {{(pid=75852) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 09:04:38 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:38 devstack cinder-volume[75680]: DEBUG dbcounter [-] [75680] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75680) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:04:38 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:04:38 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:38 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:38 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.636s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:38 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:38 devstack sudo[76940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:38 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:39 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:39 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.618s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:39 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:39 devstack sudo[76944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:39 devstack sudo[76944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:40 devstack sudo[76944]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:40 devstack sudo[76947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:40 devstack sudo[76947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:40 devstack sudo[76947]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:40 devstack cinder-volume[75852]: INFO cinder.volume.driver [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG cinder.volume.driver [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75852) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG oslo_db.sqlalchemy.engines [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75852) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG dbcounter [-] [75852] Writer thread running {{(pid=75852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG cinder.db.api [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Building query based on filter {{(pid=75852) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG cinder.image.image_utils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75852) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 09:04:40 devstack cinder-volume[75852]: INFO cinder.keymgr.migration [None req-d52e9b02-a7be-44ac-ac9b-964c72282342 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG cinder.volume.drivers.lvm [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Updating volume stats {{(pid=75852) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 09:04:40 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:40 devstack sudo[76952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:04:40 devstack sudo[76952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:41 devstack sudo[76952]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:41 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.678s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:41 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:41 devstack sudo[76959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:41 devstack sudo[76959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:42 devstack sudo[76959]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:42 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:42 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:42 devstack sudo[76962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:42 devstack sudo[76962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:42 devstack sudo[76962]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:42 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.699s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:42 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:42 devstack sudo[76966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:42 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:43 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:43 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:43 devstack cinder-volume[75852]: DEBUG cinder.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Notifying Schedulers of capabilities ... {{(pid=75852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:04:43 devstack cinder-volume[75852]: INFO cinder.volume.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Driver initialization completed successfully. Jul 07 09:04:43 devstack cinder-volume[75852]: INFO cinder.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Initiating service 2 cleanup Jul 07 09:04:43 devstack cinder-volume[75852]: INFO cinder.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Service 2 cleanup completed. Jul 07 09:04:43 devstack cinder-volume[75852]: DEBUG cinder.service [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Creating RPC server for service cinder-volume {{(pid=75852) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 09:04:43 devstack cinder-volume[75852]: DEBUG cinder.service [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75852) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 09:04:43 devstack cinder-volume[75852]: INFO cinder.volume.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 07 09:04:43 devstack cinder-volume[75852]: DEBUG cinder.volume.drivers.lvm [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Updating volume stats {{(pid=75852) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 09:04:43 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:43 devstack sudo[76969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:04:43 devstack sudo[76969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:44 devstack sudo[76969]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:44 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:44 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:44 devstack sudo[76973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:44 devstack sudo[76973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:45 devstack sudo[76973]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:45 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.669s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:45 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:45 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:04:45 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:45 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:45 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.632s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:45 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:04:45 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:04:45 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:04:46 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Jul 07 09:04:46 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:04:46 devstack cinder-volume[75852]: INFO cinder.volume.manager [None req-40a312a0-a66d-4bca-b4b6-82de5fceb960 None None] Driver post RPC initialization completed successfully. Jul 07 09:04:56 devstack cinder-volume[75852]: DEBUG dbcounter [-] [75852] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:04:56 devstack cinder-volume[75852]: DEBUG dbcounter [-] [75852] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:05:23 devstack cinder-volume[75852]: DEBUG oslo_service.periodic_task [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running periodic task VolumeManager._thread_info {{(pid=75852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:05:23 devstack cinder-volume[75852]: DEBUG cinder.volume.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] thread count: 6 {{(pid=75852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:05:23 devstack cinder-volume[75852]: DEBUG cinder.volume.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] thread info: [<_MainThread(MainThread, started 131876552134784)>, , , , , ] {{(pid=75852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:06:23 devstack cinder-volume[75852]: DEBUG oslo_service.periodic_task [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:06:23 devstack cinder-volume[75852]: DEBUG cinder.volume.drivers.lvm [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Updating volume stats {{(pid=75852) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 09:06:23 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:06:23 devstack sudo[81947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:06:23 devstack sudo[81947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:06:24 devstack sudo[81947]: pam_unix(sudo:session): session closed for user root Jul 07 09:06:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.621s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:06:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:06:24 devstack sudo[81950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:06:24 devstack sudo[81950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:06:24 devstack sudo[81950]: pam_unix(sudo:session): session closed for user root Jul 07 09:06:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:06:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:06:24 devstack sudo[81953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:06:24 devstack sudo[81953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:06:25 devstack sudo[81953]: pam_unix(sudo:session): session closed for user root Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:06:25 devstack sudo[81956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:06:25 devstack sudo[81956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:06:25 devstack sudo[81956]: pam_unix(sudo:session): session closed for user root Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG cinder.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Notifying Schedulers of capabilities ... {{(pid=75852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG oslo_service.periodic_task [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running periodic task VolumeManager._thread_info {{(pid=75852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG cinder.volume.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] thread count: 6 {{(pid=75852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:06:25 devstack cinder-volume[75852]: DEBUG cinder.volume.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] thread info: [<_MainThread(MainThread, started 131876552134784)>, , , , , ] {{(pid=75852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:06:56 devstack cinder-volume[75852]: DEBUG dbcounter [-] [75852] Writing DB stats cinder:SELECT=1 {{(pid=75852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:06:56 devstack cinder-volume[75852]: DEBUG dbcounter [-] [75852] Writing DB stats cinder:UPDATE=1 {{(pid=75852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:07:23 devstack cinder-volume[75852]: DEBUG oslo_service.periodic_task [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:07:23 devstack cinder-volume[75852]: DEBUG cinder.volume.drivers.lvm [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Updating volume stats {{(pid=75852) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 09:07:23 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:07:23 devstack sudo[83578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:07:23 devstack sudo[83578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:07:24 devstack sudo[83578]: pam_unix(sudo:session): session closed for user root Jul 07 09:07:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:07:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:07:24 devstack sudo[83601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:07:24 devstack sudo[83601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:07:24 devstack sudo[83601]: pam_unix(sudo:session): session closed for user root Jul 07 09:07:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:07:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:07:24 devstack sudo[83633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:07:24 devstack sudo[83633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:07:25 devstack sudo[83633]: pam_unix(sudo:session): session closed for user root Jul 07 09:07:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.658s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:07:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:07:25 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:07:25 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:07:26 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Jul 07 09:07:26 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:07:26 devstack cinder-volume[75852]: DEBUG cinder.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Notifying Schedulers of capabilities ... {{(pid=75852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:07:26 devstack cinder-volume[75852]: DEBUG oslo_service.periodic_task [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running periodic task VolumeManager._thread_info {{(pid=75852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:07:26 devstack cinder-volume[75852]: DEBUG cinder.volume.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] thread count: 6 {{(pid=75852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:07:26 devstack cinder-volume[75852]: DEBUG cinder.volume.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] thread info: [<_MainThread(MainThread, started 131876552134784)>, , , , , ] {{(pid=75852) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:08:23 devstack cinder-volume[75852]: DEBUG oslo_service.periodic_task [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75852) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:08:23 devstack cinder-volume[75852]: DEBUG cinder.volume.drivers.lvm [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Updating volume stats {{(pid=75852) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 07 09:08:23 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:08:23 devstack sudo[85023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 07 09:08:23 devstack sudo[85023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:08:24 devstack sudo[85023]: pam_unix(sudo:session): session closed for user root Jul 07 09:08:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:08:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:08:24 devstack sudo[85029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:08:24 devstack sudo[85029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:08:24 devstack sudo[85029]: pam_unix(sudo:session): session closed for user root Jul 07 09:08:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.614s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:08:24 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:08:24 devstack sudo[85033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 07 09:08:24 devstack sudo[85033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:08:25 devstack sudo[85033]: pam_unix(sudo:session): session closed for user root Jul 07 09:08:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:08:25 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:08:25 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 07 09:08:25 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:08:26 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Jul 07 09:08:26 devstack cinder-volume[75852]: DEBUG oslo_concurrency.processutils [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=75852) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:08:26 devstack cinder-volume[75852]: DEBUG cinder.manager [None req-6d567a98-c55c-4ef5-82a5-75ff7a08f7bf None None] Notifying Schedulers of capabilities ... {{(pid=75852) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:08:56 devstack cinder-volume[75852]: DEBUG dbcounter [-] [75852] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75852) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:09:01 devstack cinder-volume[75680]: INFO oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Caught SIGTERM, stopping children Jul 07 09:09:01 devstack cinder-volume[75680]: DEBUG oslo_concurrency.lockutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Acquiring lock "singleton_lock" {{(pid=75680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:09:01 devstack cinder-volume[75680]: DEBUG oslo_concurrency.lockutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Acquired lock "singleton_lock" {{(pid=75680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:09:01 devstack cinder-volume[75680]: DEBUG oslo_concurrency.lockutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Releasing lock "singleton_lock" {{(pid=75680) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:09:01 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Stop services. {{(pid=75680) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 09:09:01 devstack cinder-volume[75680]: DEBUG oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Killing children. {{(pid=75680) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 09:09:01 devstack cinder-volume[75680]: INFO oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Waiting on 1 children to exit Jul 07 09:09:03 devstack cinder-volume[75852]: DEBUG oslo_concurrency.lockutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Acquiring lock "singleton_lock" {{(pid=75852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:09:03 devstack cinder-volume[75852]: DEBUG oslo_concurrency.lockutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Acquired lock "singleton_lock" {{(pid=75852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:09:03 devstack cinder-volume[75852]: DEBUG oslo_concurrency.lockutils [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Releasing lock "singleton_lock" {{(pid=75852) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:09:03 devstack cinder-volume[75852]: WARNING amqp [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 09:09:03 devstack cinder-volume[75852]: WARNING amqp [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 09:09:03 devstack cinder-volume[75680]: INFO oslo_service.backend._eventlet.service [None req-787fb81c-94e7-47e0-913b-78afa8c41ea0 None None] Child 75852 exited with status 0 Jul 07 09:09:04 devstack cinder-volume[85936]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 09:09:04 devstack cinder-volume[85936]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 09:09:04 devstack cinder-volume[85936]: we strongly recommend against using it for new projects. Jul 07 09:09:04 devstack cinder-volume[85936]: If you are already using Eventlet, we recommend migrating to a different Jul 07 09:09:04 devstack cinder-volume[85936]: framework. For more detail see Jul 07 09:09:04 devstack cinder-volume[85936]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 09:09:04 devstack cinder-volume[85936]: import eventlet # noqa Jul 07 09:09:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:09:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:09:06 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:09:06 devstack cinder-volume[85936]: INFO dbcounter [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Registered counter for database cinder Jul 07 09:09:06 devstack cinder-volume[85936]: DEBUG oslo_db.sqlalchemy.engines [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85936) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG dbcounter [-] [85936] Writer thread running {{(pid=85936) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 09:09:07 devstack cinder-volume[85936]: INFO cinder.rpc [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 09:09:07 devstack cinder-volume[85936]: INFO cinder.rpc [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_db.sqlalchemy.engines [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85936) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Determined volume DB was empty at startup. Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG cinder.volume.manager [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85936) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 09:09:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 07 09:09:07 devstack cinder-volume[85936]: WARNING stevedore.named [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 09:09:07 devstack cinder-volume[85936]: WARNING castellan.key_manager [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:09:07 devstack cinder-volume[85936]: WARNING cinder.keymgr.conf_key_mgr [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:09:07 devstack cinder-volume[85936]: INFO cinder.volume.manager [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_db.sqlalchemy.engines [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85936) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:07 devstack cinder-volume[85936]: INFO oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Starting 1 workers Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Started child 86151 {{(pid=85936) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Full set of CONF: {{(pid=85936) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] ******************************************************************************** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Configuration options gathered from: {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] ================================================================================ {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] allow_availability_zone_fallback = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] allow_compression_on_image_upload = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] allowed_direct_url_schemes = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] api_rate_limit = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] auth_strategy = keystone {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_availability_zone = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_host = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_stats_polling_interval = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backup_api_class = cinder.backup.api.API {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backup_name_template = backup-%s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backup_use_same_host = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backup_use_temp_snapshot = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] chap_password = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] chap_username = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[86151]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_internal_tenant_project_id = cb56127c81294d75a617affc69ee5710 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_internal_tenant_user_id = 4317ca9ff14d496eab4f2a8c130240d6 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cluster = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] compression_format = gzip {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] compute_api_class = cinder.compute.nova.API {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] config_dir = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] config_source = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] control_exchange = openstack {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] debug = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] default_availability_zone = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] default_group_type = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] default_volume_type = QuobyteHD {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] disk_geometry = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] driver_client_cert = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] driver_client_cert_key = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] driver_data_namespace = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] driver_ssl_cert_path = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] driver_ssl_cert_verify = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] driver_use_ssl = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] enable_new_services = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] enable_unsupported_driver = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] enabled_backends = ['QuobyteHD'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] enforce_multipath_for_image_xfer = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] filter_function = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_api_insecure = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_api_ssl_compression = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_ca_certificates_file = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_catalog_info = image:glance:publicURL {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_num_retries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance_request_timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] goodness_function = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] graceful_shutdown_timeout = 5 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] group_api_class = cinder.group.api.API {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] host = devstack {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_compress_on_upload = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_conversion_address_space_limit = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_conversion_cpu_limit = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_conversion_disable = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_upload_use_cinder_backend = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_upload_use_internal_tenant = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_volume_cache_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_volume_cache_max_count = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] image_volume_cache_max_size_gb = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] init_host_max_objects_retrieval = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] instance_format = [instance: %(uuid)s] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] iscsi_target_flags = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] iscsi_write_cache = on {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] iser_helper = tgtadm {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] iser_ip_address = 192.168.122.170 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] iser_port = 3260 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_color = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_config_append = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_dir = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_file = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_options = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_rotate_interval = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_rotate_interval_type = days {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] log_rotation_type = none {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] max_age = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] max_logfile_count = 30 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] max_logfile_size_mb = 200 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] max_over_subscription_ratio = 20.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] message_reap_interval = 86400 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] message_ttl = 2592000 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] migration_create_volume_timeout_secs = 300 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] monkey_patch = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] monkey_patch_modules = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] my_ip = 192.168.122.170 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] no_snapshot_gb_quota = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] num_iser_scan_tries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] num_shell_tries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] num_volume_device_scan_tries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] nvmeof_conn_info_version = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] nvmet_ns_id = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] nvmet_port_id = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_max_limit = 1000 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_volume_ext_list = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_volume_listen_port = 8776 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_volume_use_ssl = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] osapi_volume_workers = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] per_volume_size_limit = -1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] periodic_fuzzy_delay = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] periodic_interval = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] public_endpoint = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] publish_errors = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_backup_gigabytes = 1000 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_backups = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_gigabytes = 1000 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_groups = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_snapshots = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] quota_volumes = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] rate_limit_burst = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] rate_limit_except_level = CRITICAL {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] rate_limit_interval = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] reinit_driver_count = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] replication_device = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] report_discard_supported = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] report_interval = 120 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] reservation_clean_interval = 86400 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] reservation_expire = 86400 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] reserved_image_namespaces = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] reserved_percentage = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] rpc_response_timeout = 120 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] run_external_periodic_tasks = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] scst_target_driver = iscsi {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] scst_target_iqn_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_down_time = 720 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] shell_completion = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] snapshot_name_template = snapshot-%s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] split_loggers = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] state_path = /opt/stack/data/cinder {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] storage_availability_zone = nova {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] storage_protocol = iSCSI {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] syslog_log_facility = LOG_USER {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] target_helper = lioadm {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] target_ip_address = 192.168.122.170 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] target_port = 3260 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] target_protocol = iscsi {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] target_secondary_ip_addresses = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[86151]: INFO cinder.volume.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] trace_flags = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] transport_url = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] until_refresh = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_chap_auth = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_default_quota_class = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_journal = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_json = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_multipath_for_image_xfer = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.remotefs [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86151) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_stderr = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] use_syslog = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] verify_glance_signatures = enabled {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_api_class = cinder.volume.api.API {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_backend_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_clear = zero {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_clear_ionice = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_clear_size = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_copy_bps_limit = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_dd_blocksize = 1M {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_name_template = volume-%s {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_service_inithost_offload = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volume_usage_audit_period = month {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] zoning_mode = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_concurrency.disable_process_locking = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.auth_section = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.auth_type = password {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.auth_version = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.cache = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.include_service_catalog = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.insecure = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.interface = public {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_password = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcache_username = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.region_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.service_type = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.170/identity {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.backend = dogpile.cache.null {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.backend_argument = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.backend_expiration_time = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.config_prefix = cache.oslo {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.debug_cache_backend = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.enable_retry_client = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.enable_socket_keepalive = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.expiration_time = 600 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.hashclient_retry_attempts = 2 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_dead_retry = 300 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_pool_maxsize = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_sasl_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.password = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.proxies = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.redis_db = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.redis_server = localhost:6379 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.retry_attempts = 2 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.retry_delay = 0.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.socket_keepalive_count = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.socket_keepalive_idle = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.socket_keepalive_interval = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.socket_timeout = 1.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.tls_allowed_ciphers = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.tls_cafile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.tls_certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.tls_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.tls_keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cache.username = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] coordination.backend_url = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.asyncio_connection = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.asyncio_slave_connection = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.backend = sqlalchemy {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.connection = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.connection_debug = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.connection_parameters = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.connection_recycle_time = 3600 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.connection_trace = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.db_inc_retry_interval = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.db_max_retries = 20 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.db_max_retry_interval = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.db_retry_interval = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.max_overflow = 50 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.max_pool_size = 5 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.max_retries = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.mysql_wsrep_sync_wait = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.pool_timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.retry_interval = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.slave_connection = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.sqlite_synchronous = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.synchronous_reader = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] database.use_db_reconnect = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.connection_string = messaging:// {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.es_doc_type = notification {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.es_scroll_size = 10000 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.es_scroll_time = 2m {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.filter_error_trace = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.hmac_keys = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.sentinel_service_name = mymaster {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.socket_timeout = 0.1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.trace_requests = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler.trace_sqlalchemy = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler_jaeger.process_tags = {} {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler_jaeger.service_name_prefix = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] profiler_otlp.service_name_prefix = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.enforce_new_defaults = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.enforce_scope = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.policy_default_rule = default {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.policy_file = policy.yaml {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.group = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.helper_command = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] privsep_osbrick.user = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.group = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.helper_command = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] cinder_sys_admin.user = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.auth_section = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.auth_type = password {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.cafile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.collect_timing = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.insecure = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.send_service_user_token = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.split_loggers = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] service_user.timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.auth_section = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.auth_type = password {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.collect_timing = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.insecure = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.region_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.split_loggers = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] glance.timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.backend_availability_zone = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.chap_password = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.chap_username = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.disk_geometry = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.driver_client_cert = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.driver_client_cert_key = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.driver_data_namespace = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.driver_use_ssl = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.extra_capabilities = {} {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.filter_function = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.goodness_function = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.iscsi_target_flags = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.iscsi_write_cache = on {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.iser_helper = tgtadm {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.iser_port = 3260 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_host = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_login = admin {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_mount_options = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_password = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_private_key = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_share_path = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.num_shell_tries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.quobyte_volume_url = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.replication_device = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.report_discard_supported = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.reserved_percentage = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.target_helper = tgtadm {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.target_port = 3260 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.target_protocol = iscsi {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.trace_flags = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.unique_fqdn_network = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.use_chap_auth = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_backend_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_clear = zero {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_clear_ionice = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_clear_size = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_reports.file_event_handler = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_reports.log_dir = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.backend_availability_zone = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.backend_host = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.chap_password = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.chap_username = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.chiscsi_conf = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.disk_geometry = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.driver_client_cert = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.driver_data_namespace = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.driver_use_ssl = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.extra_capabilities = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.filter_function = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.goodness_function = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.iser_helper = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.iser_ip_address = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.iser_port = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.iser_target_prefix = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_host = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_login = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_mount_options = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_password = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_private_key = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_share_path = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_ssh_port = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.num_shell_tries = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.nvmet_port_id = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.replication_device = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.report_discard_supported = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.reserved_percentage = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.scst_target_driver = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.storage_protocol = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.target_helper = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.target_ip_address = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.target_port = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.target_prefix = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.target_protocol = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.trace_flags = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.use_chap_auth = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86151) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 09:09:07 devstack cinder-volume[86151]: WARNING cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 09:09:07 devstack cinder-volume[86151]: WARNING cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_clear = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_clear_size = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] QuobyteHD.volumes_dir = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_notifications.driver = [] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_notifications.retry = -1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] key_manager.fixed_key = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.barbican_api_version = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.barbican_endpoint = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.barbican_endpoint_type = public {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.barbican_region_name = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.cafile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.collect_timing = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.insecure = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.number_of_retries = 60 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.retry_delay = 1 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.send_service_user_token = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.split_loggers = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.verify_ssl = True {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican.verify_ssl_path = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.auth_section = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.auth_type = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.cafile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.certfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.collect_timing = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.insecure = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.keyfile = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.split_loggers = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] barbican_service_user.timeout = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.approle_role_id = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.approle_secret_id = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.kv_mountpoint = secret {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.kv_path = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.kv_version = 2 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.namespace = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.root_token_id = **** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.ssl_ca_crt_file = None {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.timeout = 60.0 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.use_ssl = False {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:07 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] ******************************************************************************** {{(pid=85936) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 09:09:07 devstack quobyte-client[86158]: Reading configuration file: /etc/quobyte/client.cfg Jul 07 09:09:07 devstack quobyte-client[86158]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86151) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:07 devstack cinder-volume[86151]: INFO cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 ... Jul 07 09:09:07 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b -c /etc/quobyte/client-cinder.cfg {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:08 devstack sudo[86159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b -c /etc/quobyte/client-cinder.cfg Jul 07 09:09:08 devstack sudo[86159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:08 devstack sudo[86159]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:08 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.764s {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:08 devstack cinder-volume[86151]: INFO cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 succeeded Jul 07 09:09:08 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86151) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:08 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.773s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:08 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:08 devstack sudo[86228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:08 devstack sudo[86228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:09 devstack sudo[86228]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.656s {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:09 devstack cinder-volume[86151]: INFO cinder.volume.driver [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG cinder.volume.driver [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86151) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG oslo_db.sqlalchemy.engines [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86151) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG dbcounter [-] [86151] Writer thread running {{(pid=86151) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG cinder.db.api [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Building query based on filter {{(pid=86151) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG cinder.image.image_utils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86151) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 09:09:09 devstack cinder-volume[86151]: INFO cinder.keymgr.migration [None req-e486056e-1230-42fe-9684-de08ba9a7913 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86151) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86151) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:09 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:09 devstack sudo[86231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:09 devstack sudo[86231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:10 devstack sudo[86231]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.726s {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG cinder.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Notifying Schedulers of capabilities ... {{(pid=86151) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:09:10 devstack cinder-volume[86151]: INFO cinder.volume.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Driver initialization completed successfully. Jul 07 09:09:10 devstack cinder-volume[86151]: INFO cinder.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Initiating service 3 cleanup Jul 07 09:09:10 devstack cinder-volume[86151]: INFO cinder.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Service 3 cleanup completed. Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG cinder.service [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Creating RPC server for service cinder-volume {{(pid=86151) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG cinder.service [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86151) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 09:09:10 devstack cinder-volume[86151]: INFO cinder.volume.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86151) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86151) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:10 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:10 devstack sudo[86265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:10 devstack sudo[86265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:11 devstack sudo[86265]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:11 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.052s {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:11 devstack cinder-volume[86151]: INFO cinder.volume.manager [None req-a5fdc5d8-050a-4eb4-850a-0e7cc74b7ce0 None None] Driver post RPC initialization completed successfully. Jul 07 09:09:14 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:14 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:14 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86151) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:14 devstack cinder-volume[86151]: DEBUG cinder.volume.drivers.quobyte [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86151) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:14 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86151) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:14 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:14 devstack sudo[86355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:14 devstack sudo[86355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:15 devstack sudo[86355]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:15 devstack cinder-volume[86151]: DEBUG oslo_concurrency.processutils [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.613s {{(pid=86151) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:15 devstack cinder-volume[86151]: DEBUG cinder.manager [None req-6b3ee997-befc-46f2-b100-b380a144abb8 None None] Notifying Schedulers of capabilities ... {{(pid=86151) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:09:17 devstack cinder-volume[85936]: INFO oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Caught SIGTERM, stopping children Jul 07 09:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Acquiring lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Acquired lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:09:17 devstack cinder-volume[85936]: DEBUG oslo_concurrency.lockutils [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Releasing lock "singleton_lock" {{(pid=85936) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:09:17 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Stop services. {{(pid=85936) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 07 09:09:17 devstack cinder-volume[85936]: DEBUG oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Killing children. {{(pid=85936) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 07 09:09:17 devstack cinder-volume[85936]: INFO oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Waiting on 1 children to exit Jul 07 09:09:18 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Acquiring lock "singleton_lock" {{(pid=86151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:09:18 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Acquired lock "singleton_lock" {{(pid=86151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:09:18 devstack cinder-volume[86151]: DEBUG oslo_concurrency.lockutils [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Releasing lock "singleton_lock" {{(pid=86151) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:09:18 devstack cinder-volume[86151]: WARNING amqp [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 09:09:18 devstack cinder-volume[86151]: WARNING amqp [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 07 09:09:18 devstack cinder-volume[85936]: INFO oslo_service.backend._eventlet.service [None req-72176d1b-fb1c-4969-a24a-ceac480f03a2 None None] Child 86151 exited with status 0 Jul 07 09:09:19 devstack cinder-volume[86491]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 07 09:09:19 devstack cinder-volume[86491]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 09:09:19 devstack cinder-volume[86491]: we strongly recommend against using it for new projects. Jul 07 09:09:19 devstack cinder-volume[86491]: If you are already using Eventlet, we recommend migrating to a different Jul 07 09:09:19 devstack cinder-volume[86491]: framework. For more detail see Jul 07 09:09:19 devstack cinder-volume[86491]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 09:09:19 devstack cinder-volume[86491]: import eventlet # noqa Jul 07 09:09:22 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86491) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 07 09:09:22 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86491) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 07 09:09:22 devstack cinder-volume[86491]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86491) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 07 09:09:22 devstack cinder-volume[86491]: INFO dbcounter [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Registered counter for database cinder Jul 07 09:09:23 devstack cinder-volume[86491]: DEBUG oslo_db.sqlalchemy.engines [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86491) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:23 devstack cinder-volume[86491]: DEBUG dbcounter [-] [86491] Writer thread running {{(pid=86491) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 09:09:23 devstack cinder-volume[86491]: INFO cinder.rpc [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 07 09:09:23 devstack cinder-volume[86491]: INFO cinder.rpc [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 07 09:09:23 devstack cinder-volume[86491]: DEBUG oslo_db.sqlalchemy.engines [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86491) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:23 devstack cinder-volume[86491]: INFO cinder.volume.manager [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Determined volume DB was empty at startup. Jul 07 09:09:23 devstack cinder-volume[86491]: DEBUG cinder.volume.manager [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86491) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 07 09:09:23 devstack cinder-volume[86491]: WARNING stevedore.named [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 07 09:09:23 devstack cinder-volume[86491]: WARNING castellan.key_manager [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:09:23 devstack cinder-volume[86491]: WARNING cinder.keymgr.conf_key_mgr [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 07 09:09:23 devstack cinder-volume[86491]: INFO cinder.volume.manager [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 07 09:09:23 devstack cinder-volume[86491]: DEBUG oslo_db.sqlalchemy.engines [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86491) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:23 devstack cinder-volume[86491]: INFO oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Starting 1 workers Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Started child 86769 {{(pid=86491) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Full set of CONF: {{(pid=86491) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] ******************************************************************************** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] Configuration options gathered from: {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 07 09:09:24 devstack cinder-volume[86769]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] ================================================================================ {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] allow_availability_zone_fallback = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] allow_compression_on_image_upload = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] allowed_direct_url_schemes = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] api_rate_limit = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] auth_strategy = keystone {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_availability_zone = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_host = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_stats_polling_interval = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backup_api_class = cinder.backup.api.API {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backup_name_template = backup-%s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backup_use_same_host = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backup_use_temp_snapshot = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] chap_password = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] chap_username = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_internal_tenant_project_id = cb56127c81294d75a617affc69ee5710 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_internal_tenant_user_id = 4317ca9ff14d496eab4f2a8c130240d6 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cluster = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] compression_format = gzip {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] compute_api_class = cinder.compute.nova.API {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] config_dir = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] config_source = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] control_exchange = openstack {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] debug = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] default_availability_zone = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] default_group_type = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] default_volume_type = QuobyteHD {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] disk_geometry = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] driver_client_cert = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] driver_client_cert_key = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] driver_data_namespace = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] driver_ssl_cert_path = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] driver_ssl_cert_verify = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] driver_use_ssl = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] enable_new_services = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] enable_unsupported_driver = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] enabled_backends = ['QuobyteHD'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] enforce_multipath_for_image_xfer = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] filter_function = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_api_insecure = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_api_servers = ['http://192.168.122.170/image'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_api_ssl_compression = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_ca_certificates_file = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_catalog_info = image:glance:publicURL {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_num_retries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance_request_timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] goodness_function = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86769) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] graceful_shutdown_timeout = 5 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] group_api_class = cinder.group.api.API {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] host = devstack {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_compress_on_upload = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_conversion_address_space_limit = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_conversion_cpu_limit = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_conversion_disable = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_upload_use_cinder_backend = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_upload_use_internal_tenant = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_volume_cache_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_volume_cache_max_count = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] image_volume_cache_max_size_gb = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] init_host_max_objects_retrieval = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] instance_format = [instance: %(uuid)s] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] iscsi_target_flags = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] iscsi_write_cache = on {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] iser_helper = tgtadm {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] iser_ip_address = 192.168.122.170 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] iser_port = 3260 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_color = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_config_append = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_dir = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_file = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_options = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_rotate_interval = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_rotate_interval_type = days {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] log_rotation_type = none {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] max_age = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] max_logfile_count = 30 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] max_logfile_size_mb = 200 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] max_over_subscription_ratio = 20.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] message_reap_interval = 86400 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] message_ttl = 2592000 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] migration_create_volume_timeout_secs = 300 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] monkey_patch = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] monkey_patch_modules = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] my_ip = 192.168.122.170 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] no_snapshot_gb_quota = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] num_iser_scan_tries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] num_shell_tries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] num_volume_device_scan_tries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] nvmeof_conn_info_version = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] nvmet_ns_id = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] nvmet_port_id = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_max_limit = 1000 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_volume_ext_list = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_volume_listen_port = 8776 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_volume_use_ssl = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] osapi_volume_workers = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] per_volume_size_limit = -1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] periodic_fuzzy_delay = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] periodic_interval = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] public_endpoint = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] publish_errors = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_backup_gigabytes = 1000 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_backups = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_gigabytes = 1000 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_groups = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_snapshots = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] quota_volumes = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] rate_limit_burst = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] rate_limit_except_level = CRITICAL {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] rate_limit_interval = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] reinit_driver_count = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] replication_device = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] report_discard_supported = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] report_interval = 120 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] reservation_clean_interval = 86400 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] reservation_expire = 86400 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] reserved_image_namespaces = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] reserved_percentage = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] rpc_response_timeout = 120 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] run_external_periodic_tasks = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] scst_target_driver = iscsi {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] scst_target_iqn_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_down_time = 720 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] shell_completion = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] snapshot_name_template = snapshot-%s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] split_loggers = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] state_path = /opt/stack/data/cinder {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] storage_availability_zone = nova {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] storage_protocol = iSCSI {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] syslog_log_facility = LOG_USER {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86769) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 07 09:09:24 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 07 09:09:24 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] target_helper = lioadm {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] target_ip_address = 192.168.122.170 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] target_port = 3260 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] target_protocol = iscsi {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] target_secondary_ip_addresses = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] trace_flags = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] transport_url = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] until_refresh = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_chap_auth = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_default_quota_class = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_journal = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_json = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_multipath_for_image_xfer = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_stderr = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Running cmd (subprocess): mount.quobyte {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] use_syslog = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] verify_glance_signatures = enabled {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_api_class = cinder.volume.api.API {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_backend_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_clear = zero {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_clear_ionice = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_clear_size = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_copy_bps_limit = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_dd_blocksize = 1M {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_name_template = volume-%s {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_service_inithost_offload = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volume_usage_audit_period = month {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] zoning_mode = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_concurrency.disable_process_locking = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.auth_section = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.auth_type = password {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.auth_version = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.cache = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.include_service_catalog = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.insecure = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.interface = public {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_password = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcache_username = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.region_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.service_type = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.170/identity {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.backend = dogpile.cache.null {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.backend_argument = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.backend_expiration_time = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.config_prefix = cache.oslo {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.debug_cache_backend = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.enable_retry_client = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.enable_socket_keepalive = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.expiration_time = 600 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.hashclient_retry_attempts = 2 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_dead_retry = 300 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_pool_maxsize = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_sasl_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.password = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.proxies = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.redis_db = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.redis_server = localhost:6379 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.retry_attempts = 2 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.retry_delay = 0.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.socket_keepalive_count = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.socket_keepalive_idle = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.socket_keepalive_interval = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.socket_timeout = 1.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.tls_allowed_ciphers = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.tls_cafile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.tls_certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.tls_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.tls_keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cache.username = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] coordination.backend_url = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.asyncio_connection = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.asyncio_slave_connection = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.backend = sqlalchemy {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.connection = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.connection_debug = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.connection_parameters = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.connection_recycle_time = 3600 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.connection_trace = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.db_inc_retry_interval = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.db_max_retries = 20 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.db_max_retry_interval = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.db_retry_interval = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.max_overflow = 50 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.max_pool_size = 5 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.max_retries = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.mysql_wsrep_sync_wait = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.pool_timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.retry_interval = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.slave_connection = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.sqlite_synchronous = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.synchronous_reader = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] database.use_db_reconnect = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.connection_string = messaging:// {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.es_doc_type = notification {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.es_scroll_size = 10000 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.es_scroll_time = 2m {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.filter_error_trace = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.hmac_keys = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.sentinel_service_name = mymaster {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.socket_timeout = 0.1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.trace_requests = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler.trace_sqlalchemy = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler_jaeger.process_tags = {} {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler_jaeger.service_name_prefix = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] profiler_otlp.service_name_prefix = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.enforce_new_defaults = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.enforce_scope = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.policy_default_rule = default {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.policy_file = policy.yaml {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.group = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.helper_command = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] privsep_osbrick.user = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.group = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.helper_command = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] cinder_sys_admin.user = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.auth_section = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.auth_type = password {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.cafile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.collect_timing = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.insecure = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.send_service_user_token = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.split_loggers = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] service_user.timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.auth_section = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.auth_type = password {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.collect_timing = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.insecure = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.region_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.split_loggers = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] glance.timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.backend_availability_zone = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.chap_password = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.chap_username = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.disk_geometry = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.driver_client_cert = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.driver_client_cert_key = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.driver_data_namespace = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.driver_use_ssl = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.extra_capabilities = {} {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.filter_function = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.goodness_function = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.iscsi_target_flags = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.iscsi_write_cache = on {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] CMD "mount.quobyte" returned: 1 in 0.143s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.iser_helper = tgtadm {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.iser_ip_address = 192.168.122.170 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.iser_port = 3260 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_host = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_login = admin {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_mount_options = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_password = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_private_key = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_share_path = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.num_shell_tries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.quobyte_volume_url = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.replication_device = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.report_discard_supported = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.reserved_percentage = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.target_helper = tgtadm {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.target_ip_address = 192.168.122.170 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.target_port = 3260 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.target_protocol = iscsi {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.trace_flags = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.unique_fqdn_network = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.use_chap_auth = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_backend_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_clear = zero {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_clear_ionice = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_clear_size = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_reports.file_event_handler = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_reports.log_dir = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.backend_availability_zone = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.backend_host = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.chap_password = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.chap_username = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.chiscsi_conf = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.disk_geometry = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.driver_client_cert = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.driver_data_namespace = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.driver_use_ssl = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.extra_capabilities = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.filter_function = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.goodness_function = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.iser_helper = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.iser_ip_address = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.iser_port = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.iser_target_prefix = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_host = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_login = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_mount_options = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_password = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_private_key = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_share_path = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_ssh_port = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.num_shell_tries = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.nvmet_port_id = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.replication_device = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.report_discard_supported = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.reserved_percentage = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.scst_target_driver = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.storage_protocol = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.target_helper = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.target_ip_address = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.target_port = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.target_prefix = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.target_protocol = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.trace_flags = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.use_chap_auth = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_clear = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_clear_size = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] QuobyteHD.volumes_dir = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack sudo[86780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack sudo[86780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_notifications.driver = [] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_notifications.retry = -1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] key_manager.fixed_key = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.barbican_api_version = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.barbican_endpoint = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.barbican_endpoint_type = public {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.barbican_region_name = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.cafile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.collect_timing = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.insecure = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.number_of_retries = 60 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.retry_delay = 1 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.send_service_user_token = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.split_loggers = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.verify_ssl = True {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican.verify_ssl_path = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.auth_section = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.auth_type = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.cafile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.certfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.collect_timing = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.insecure = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.keyfile = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.split_loggers = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] barbican_service_user.timeout = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.approle_role_id = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.approle_secret_id = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.kv_mountpoint = secret {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.kv_path = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.kv_version = 2 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.namespace = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.root_token_id = **** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.ssl_ca_crt_file = None {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.timeout = 60.0 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.use_ssl = False {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 07 09:09:24 devstack cinder-volume[86491]: DEBUG oslo_service.backend._eventlet.service [None req-b64e1c42-05c3-4d50-899c-84064dd5112a None None] ******************************************************************************** {{(pid=86491) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 07 09:09:25 devstack sudo[86780]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.775s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:25 devstack cinder-volume[86769]: INFO cinder.volume.driver [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Driver hasn't implemented _init_vendor_properties() Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG cinder.volume.driver [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86769) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_db.sqlalchemy.engines [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writer thread running {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG cinder.db.api [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Building query based on filter {{(pid=86769) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86769) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:25 devstack cinder-volume[86769]: INFO cinder.keymgr.migration [None req-7ae183fc-773d-43fc-8846-1f6497dee09a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 07 09:09:25 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:25 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.753s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:25 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:09:25 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Driver initialization completed successfully. Jul 07 09:09:26 devstack cinder-volume[86769]: INFO cinder.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Initiating service 3 cleanup Jul 07 09:09:26 devstack cinder-volume[86769]: INFO cinder.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Service 3 cleanup completed. Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.service [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Creating RPC server for service cinder-volume {{(pid=86769) start /opt/stack/cinder/cinder/service.py:231}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.service [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86769) start /opt/stack/cinder/cinder/service.py:237}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:26 devstack sudo[86838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:26 devstack sudo[86838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:09:26 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:09:26 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:09:26 devstack sudo[86838]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.666s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-5c9d2319-546b-46fe-ab1e-9f6b08488e5d None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:09:26 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.657s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:09:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-79ff8244-e1a3-4934-8f6d-0d15f814a946 None None] Driver post RPC initialization completed successfully. Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 6 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:09:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:09:33 devstack cinder-volume[86491]: DEBUG dbcounter [-] [86491] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86491) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:09:36 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:09:36 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:10:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:10:26 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:10:26 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Flow 'volume_create_manager' (f459b0b7-3a33-4d8a-bfff-4bee7f9fcb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dedc489e-d32f-4a01-9e41-3b5714867b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dedc489e-d32f-4a01-9e41-3b5714867b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-50241032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c97c07-be6c-4478-8dab-7d36741bff0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af11c7718081490c8c9de10c2cbba711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:10:27Z,use_quota=True,user_id='d19a99907ab444f89e8600ec660011ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e888d29-38c2-43d9-80df-624c31fc53d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e888d29-38c2-43d9-80df-624c31fc53d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5cf572-66ad-4728-bfb0-54f7ddf21996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5cf572-66ad-4728-bfb0-54f7ddf21996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0c97c07-be6c-4478-8dab-7d36741bff0e', 'volume_name': 'volume-c0c97c07-be6c-4478-8dab-7d36741bff0e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dfe3f0-86bc-4f7c-a043-5c156c8e2815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93dfe3f0-86bc-4f7c-a043-5c156c8e2815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696e191a-9396-42a0-b03a-b79080408a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:27 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Volume c0c97c07-be6c-4478-8dab-7d36741bff0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0c97c07-be6c-4478-8dab-7d36741bff0e', 'volume_size': 1} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-50241032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0c97c07-be6c-4478-8dab-7d36741bff0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af11c7718081490c8c9de10c2cbba711',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:10:27Z,use_quota=True,user_id='d19a99907ab444f89e8600ec660011ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Creating volume c0c97c07-be6c-4478-8dab-7d36741bff0e {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:10:27 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:10:27 devstack sudo[87155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e 1073741824 Jul 07 09:10:27 devstack sudo[87155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:10:27 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 6 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:10:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:10:28 devstack sudo[87155]: pam_unix(sudo:session): session closed for user root Jul 07 09:10:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e 1073741824" returned: 0 in 1.091s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:10:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:10:28 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e Jul 07 09:10:28 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:10:29 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e" returned: 0 in 0.831s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (696e191a-9396-42a0-b03a-b79080408a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0c97c07-be6c-4478-8dab-7d36741bff0e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73e2222-cba3-486c-9d38-b6bdbb183f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:29 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Volume volume-c0c97c07-be6c-4478-8dab-7d36741bff0e (c0c97c07-be6c-4478-8dab-7d36741bff0e): created successfully Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a73e2222-cba3-486c-9d38-b6bdbb183f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Flow 'volume_create_manager' (f459b0b7-3a33-4d8a-bfff-4bee7f9fcb34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:10:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d47031f2-431b-45b6-bcaf-c7765580c0a8 tempest-TaggedAttachmentsTest-693579014 None] Created volume successfully. Jul 07 09:10:39 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:10:39 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Flow 'volume_create_manager' (d6819a07-aa06-489a-8cd3-f15318396fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf407bd-b766-4698-aa22-453861ff2f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf407bd-b766-4698-aa22-453861ff2f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1599509728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ed310a-bb20-4013-88af-cf98544f0d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9086e022e5f9472fa50966dbbf87be0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:10:46Z,use_quota=True,user_id='4da71226148c42b0ac1e35e783c3c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793ad5a3-3d37-466b-bfad-d404450980e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (793ad5a3-3d37-466b-bfad-d404450980e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5748b70-43cb-4a1f-953f-2f30b2821797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5748b70-43cb-4a1f-953f-2f30b2821797) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65ed310a-bb20-4013-88af-cf98544f0d5b', 'volume_name': 'volume-65ed310a-bb20-4013-88af-cf98544f0d5b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c596f27e-dd25-46f1-855d-96180b1b4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c596f27e-dd25-46f1-855d-96180b1b4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67052169-c4b1-4c59-9a53-15ae21f7b5de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Volume 65ed310a-bb20-4013-88af-cf98544f0d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65ed310a-bb20-4013-88af-cf98544f0d5b', 'volume_size': 1} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1599509728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65ed310a-bb20-4013-88af-cf98544f0d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9086e022e5f9472fa50966dbbf87be0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:10:46Z,use_quota=True,user_id='4da71226148c42b0ac1e35e783c3c56a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Creating volume 65ed310a-bb20-4013-88af-cf98544f0d5b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:10:46 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:10:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:10:46 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b 1073741824 Jul 07 09:10:46 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:10:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b 1073741824" returned: 0 in 2.092s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:10:48 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Jul 07 09:10:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:10:48 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b Jul 07 09:10:48 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:10:49 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Jul 07 09:10:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b" returned: 0 in 1.317s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:10:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] <== create_volume: return (3462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:10:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.465s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:10:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67052169-c4b1-4c59-9a53-15ae21f7b5de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65ed310a-bb20-4013-88af-cf98544f0d5b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac0412c-9e97-4bd3-bf05-e4cac2213885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:10:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Volume volume-65ed310a-bb20-4013-88af-cf98544f0d5b (65ed310a-bb20-4013-88af-cf98544f0d5b): created successfully Jul 07 09:10:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ac0412c-9e97-4bd3-bf05-e4cac2213885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:10:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Flow 'volume_create_manager' (d6819a07-aa06-489a-8cd3-f15318396fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:10:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e930c816-68d5-466a-bd6f-2a98f5fd4b7f tempest-DeleteServersTestJSON-1499677197 None] Created volume successfully. Jul 07 09:10:58 devstack cinder-volume[86769]: WARNING py.warnings [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 07 09:10:58 devstack cinder-volume[86769]: .first() Jul 07 09:10:58 devstack cinder-volume[86769]: Jul 07 09:10:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:10:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:10:58 devstack cinder-volume[86769]: INFO oslo.privsep.daemon [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3ogbk_gi/privsep.sock'] Jul 07 09:10:58 devstack sudo[87901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3ogbk_gi/privsep.sock Jul 07 09:10:58 devstack sudo[87901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 09:10:59 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: Jul 07 09:11:00 devstack cinder-volume[86769]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 07 09:11:01 devstack sudo[87901]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:01 devstack cinder-volume[86769]: INFO oslo.privsep.daemon [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Spawned new privsep daemon via rootwrap Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Accepted privsep connection to /tmp/tmp3ogbk_gi/privsep.sock {{(pid=86769) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 07 09:11:01 devstack cinder-volume[86769]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 07 09:11:01 devstack cinder-volume[86769]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 07 09:11:01 devstack cinder-volume[86769]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 07 09:11:01 devstack cinder-volume[86769]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87929 Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a47472c-14d7-459b-9845-38750a39f4cf]: (2,) {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[74429929-896d-471b-95c9-68dae25537be]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:01 devstack sudo[87931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b Jul 07 09:11:01 devstack sudo[87931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Flow 'volume_create_manager' (f0a0dca3-d356-4265-9c48-a70948b2f20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a8711b-6ced-4514-9d8f-dae8f32b28d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9a8711b-6ced-4514-9d8f-dae8f32b28d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1524534533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56f9500-07e1-4d39-b6d9-7e0156e97382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2c55d621204c80ac4c2caa35a1c2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:11:02Z,use_quota=True,user_id='57567f6e124346b1a0bd35dc8450e13b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ea0bc7-f510-45c4-86d0-884f98d2163f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57ea0bc7-f510-45c4-86d0-884f98d2163f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcc2b28-1321-406f-8fb3-32b338e42e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcc2b28-1321-406f-8fb3-32b338e42e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f56f9500-07e1-4d39-b6d9-7e0156e97382', 'volume_name': 'volume-f56f9500-07e1-4d39-b6d9-7e0156e97382', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2327bf-18de-4f3c-9634-a93baadf23aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a2327bf-18de-4f3c-9634-a93baadf23aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b648e28-8f23-4379-b39c-021809490253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:01 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Volume f56f9500-07e1-4d39-b6d9-7e0156e97382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f56f9500-07e1-4d39-b6d9-7e0156e97382', 'volume_size': 1} Jul 07 09:11:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:02 devstack sudo[87931]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b" returned: 0 in 1.570s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 4.086s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.902s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1524534533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f56f9500-07e1-4d39-b6d9-7e0156e97382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac2c55d621204c80ac4c2caa35a1c2ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:11:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:11:02Z,use_quota=True,user_id='57567f6e124346b1a0bd35dc8450e13b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Creating volume f56f9500-07e1-4d39-b6d9-7e0156e97382 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:11:02 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:11:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:02 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 1073741824 Jul 07 09:11:02 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-65ed310a-bb20-4013-88af-cf98544f0d5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8ca6ef7d-4ebe-48b0-b69a-b2be461e346d', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:11:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-5760a7b4-414b-4249-b87d-25ed7b4fee7c req-be202b33-988b-4973-87f6-dfea053f44cb tempest-DeleteServersTestJSON-1499677197 None] attachment_update completed successfully. Jul 07 09:11:04 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 1073741824" returned: 0 in 1.471s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:04 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 Jul 07 09:11:04 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:05 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382" returned: 0 in 1.388s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] <== create_volume: return (2931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.944s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b648e28-8f23-4379-b39c-021809490253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f56f9500-07e1-4d39-b6d9-7e0156e97382', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07186cc-9c27-49ec-aeec-9f5e37d118d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Volume volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 (f56f9500-07e1-4d39-b6d9-7e0156e97382): created successfully Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d07186cc-9c27-49ec-aeec-9f5e37d118d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Flow 'volume_create_manager' (f0a0dca3-d356-4265-9c48-a70948b2f20d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:11:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-87a1b320-3eb7-4f69-b94e-42ed36265161 tempest-VolumesAdminNegativeTest-1238196824 None] Created volume successfully. Jul 07 09:11:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Acquiring lock "cinder-f56f9500-07e1-4d39-b6d9-7e0156e97382-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "cinder-f56f9500-07e1-4d39-b6d9-7e0156e97382-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Acquiring lock "cinder-quobyte-f56f9500-07e1-4d39-b6d9-7e0156e97382" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "cinder-quobyte-f56f9500-07e1-4d39-b6d9-7e0156e97382" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4551efa9-5bef-4274-8424-8ef5e0f188fb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:08 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 Jul 07 09:11:08 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:09 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382" returned: 0 in 1.682s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:09 devstack sudo[88341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382 Jul 07 09:11:09 devstack sudo[88341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:11 devstack sudo[88341]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f56f9500-07e1-4d39-b6d9-7e0156e97382" returned: 0 in 2.028s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "cinder-quobyte-f56f9500-07e1-4d39-b6d9-7e0156e97382" released by "delete_volume" :: held 3.831s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:11 devstack cinder-volume[86769]: WARNING cinder.quota [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:11:11 devstack cinder-volume[86769]: WARNING cinder.quota [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Created reservations ['46cba533-237c-49d8-a6ca-f83c3ad5a498', 'a6bfa4c8-d7f5-4c67-841b-4dd510b8e471', '4034a6c1-a0f3-4cca-9ff8-af3b1898dbc7', '1b03911e-d0c9-4889-8a93-30c9a6d8653a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:12 devstack sudo[88391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:11:12 devstack sudo[88391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:13 devstack sudo[88391]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.572s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:13 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:11:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Deleted volume successfully. Jul 07 09:11:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ab9b591-299b-471d-8751-968662ee1ec1 tempest-VolumesAdminNegativeTest-1238196824 None] Lock "cinder-f56f9500-07e1-4d39-b6d9-7e0156e97382-delete_volume" released by "delete_volume" :: held 6.184s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-dcf0b031-af64-48b4-bd83-231788836839 req-ff7d951c-3049-4742-b6fa-5d2e6a4386f5 tempest-DeleteServersTestJSON-1499677197 None] Terminate volume connection completed successfully. Jul 07 09:11:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-dcf0b031-af64-48b4-bd83-231788836839 req-ff7d951c-3049-4742-b6fa-5d2e6a4386f5 tempest-DeleteServersTestJSON-1499677197 None] Deleting attachment 8ca6ef7d-4ebe-48b0-b69a-b2be461e346d. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:11:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Acquiring lock "cinder-65ed310a-bb20-4013-88af-cf98544f0d5b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Lock "cinder-65ed310a-bb20-4013-88af-cf98544f0d5b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Acquiring lock "cinder-quobyte-65ed310a-bb20-4013-88af-cf98544f0d5b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Lock "cinder-quobyte-65ed310a-bb20-4013-88af-cf98544f0d5b" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc8f2f0-c983-4956-8318-88f464ef0eea]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:20 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b Jul 07 09:11:20 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:21 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b" returned: 0 in 0.738s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:21 devstack sudo[88488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b Jul 07 09:11:21 devstack sudo[88488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:21 devstack sudo[88488]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-65ed310a-bb20-4013-88af-cf98544f0d5b" returned: 0 in 0.711s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Lock "cinder-quobyte-65ed310a-bb20-4013-88af-cf98544f0d5b" released by "delete_volume" :: held 1.499s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:21 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Created reservations ['07da5fbe-56c2-45d8-8638-7be7428e0881', 'ea15d7da-b6ce-496a-ae3d-0f0e7e937640', 'dc58fb69-2e83-4bd6-a92d-c8fde843d42d', 'ade774c8-725c-4ad3-9c41-c6bc5e9690bc'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:11:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:22 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:11:22 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:23 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.985s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:23 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:11:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Deleted volume successfully. Jul 07 09:11:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-71f847ea-3e9d-40dd-9c18-d97967cf2c02 tempest-DeleteServersTestJSON-1499677197 None] Lock "cinder-65ed310a-bb20-4013-88af-cf98544f0d5b-delete_volume" released by "delete_volume" :: held 2.728s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:27 devstack sudo[88562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:11:27 devstack sudo[88562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:27 devstack sudo[88562]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.965s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:11:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:11:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 8 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:11:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Flow 'volume_create_manager' (abd9619b-1a8e-4645-8270-50e9ad1d7abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c215cb-e8b1-4c99-bf2b-6fe53deb0515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c215cb-e8b1-4c99-bf2b-6fe53deb0515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1793964471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa49b6c5-ddc6-44c6-8624-36656037551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a30b505ebdc49109900f6c2a0aefb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:11:35Z,use_quota=True,user_id='a6f8136a002342c090af3248f7f0f90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc97300-a543-4ec8-b253-54d800c1a0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc97300-a543-4ec8-b253-54d800c1a0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec12a918-c3fc-47d3-a065-f2cb853ae357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec12a918-c3fc-47d3-a065-f2cb853ae357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa49b6c5-ddc6-44c6-8624-36656037551b', 'volume_name': 'volume-fa49b6c5-ddc6-44c6-8624-36656037551b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1875e7-4c4f-4741-9ada-587429b677ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d1875e7-4c4f-4741-9ada-587429b677ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab12e6d-4433-44e3-95d7-ed0ae7451168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:34 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Volume fa49b6c5-ddc6-44c6-8624-36656037551b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa49b6c5-ddc6-44c6-8624-36656037551b', 'volume_size': 1} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:11:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1793964471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa49b6c5-ddc6-44c6-8624-36656037551b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a30b505ebdc49109900f6c2a0aefb57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:11:35Z,use_quota=True,user_id='a6f8136a002342c090af3248f7f0f90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Creating volume fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:11:34 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:11:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:34 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b 1073741824 Jul 07 09:11:34 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:36 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b 1073741824" returned: 0 in 1.739s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:36 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b Jul 07 09:11:36 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:37 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b" returned: 0 in 1.129s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] <== create_volume: return (2921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.924s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab12e6d-4433-44e3-95d7-ed0ae7451168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa49b6c5-ddc6-44c6-8624-36656037551b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45768166-fd90-4e0e-acd1-213d0d7ba492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Volume volume-fa49b6c5-ddc6-44c6-8624-36656037551b (fa49b6c5-ddc6-44c6-8624-36656037551b): created successfully Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45768166-fd90-4e0e-acd1-213d0d7ba492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Flow 'volume_create_manager' (abd9619b-1a8e-4645-8270-50e9ad1d7abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:11:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-7c0bcebe-1bd4-4a07-ae77-24df5e441bbd req-d4ab9b86-1d18-47d0-b463-430ab1520e76 tempest-VolumesSnapshotsTestJSON-1836638741 None] Created volume successfully. Jul 07 09:11:39 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:11:39 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=22,cinder:UPDATE=31,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:11:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Creating offline snapshot fcd7d63c-f367-4d8f-85ab-23f1665d7947 of volume fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:11:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[da69863b-dafe-4180-8445-acc23ce9293a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:40 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b Jul 07 09:11:40 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:41 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b" returned: 0 in 1.560s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:41 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 1G Jul 07 09:11:41 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:43 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 1G" returned: 0 in 1.697s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa49b6c5-ddc6-44c6-8624-36656037551b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:43 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa49b6c5-ddc6-44c6-8624-36656037551b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 Jul 07 09:11:43 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:44 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa49b6c5-ddc6-44c6-8624-36656037551b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947" returned: 0 in 1.032s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:44 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 is being set with open permissions: ugo+rw Jul 07 09:11:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:44 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 Jul 07 09:11:44 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:45 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947" returned: 0 in 1.070s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:45 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info Jul 07 09:11:45 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:46 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info" returned: 0 in 1.043s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:46 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info is being set with open permissions: ugo+rw Jul 07 09:11:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:46 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info Jul 07 09:11:46 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:47 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.info" returned: 0 in 0.819s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.505s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.203s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee07a38-708a-4277-a299-68dab84a1adb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-43d07c95-15fb-4014-b545-32f6ca66329d req-79b68df7-c7c4-4c22-bea9-3e4dcbe61b5d tempest-VolumesSnapshotsTestJSON-1836638741 None] Create snapshot completed successfully Jul 07 09:11:47 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e Jul 07 09:11:47 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "cinder-fcd7d63c-f367-4d8f-85ab-23f1665d7947-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-fcd7d63c-f367-4d8f-85ab-23f1665d7947-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "cinder-quobyte-fa49b6c5-ddc6-44c6-8624-36656037551b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-quobyte-fa49b6c5-ddc6-44c6-8624-36656037551b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "cinder-quobyte-fcd7d63c-f367-4d8f-85ab-23f1665d7947" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-quobyte-fcd7d63c-f367-4d8f-85ab-23f1665d7947" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Deleting offline snapshot fcd7d63c-f367-4d8f-85ab-23f1665d7947 of volume fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] snapshot_file for this snap is: volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5292b50-f621-48ae-a0e9-8af67f54d913]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:48 devstack sudo[88837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 Jul 07 09:11:48 devstack sudo[88837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:48 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e" returned: 0 in 0.972s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-c0c97c07-be6c-4478-8dab-7d36741bff0e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61093002-4806-43f1-978d-9f586a1421ec', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:11:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-37157904-7015-45ae-8e62-09b250378d4c req-61da7666-75b5-4ec2-b27e-a9f1ab9b7af4 tempest-TaggedAttachmentsTest-693579014 None] attachment_update completed successfully. Jul 07 09:11:48 devstack sudo[88837]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947" returned: 0 in 0.842s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa49b6c5-ddc6-44c6-8624-36656037551b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:11:49 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a46bb-2413-4b7c-be82-ccd43ab6fa0e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:49 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b Jul 07 09:11:49 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:49 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b" returned: 0 in 0.925s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:49 devstack sudo[89237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 Jul 07 09:11:49 devstack sudo[89237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:50 devstack sudo[89237]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947" returned: 0 in 0.742s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:50 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947 Jul 07 09:11:50 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:51 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b.fcd7d63c-f367-4d8f-85ab-23f1665d7947" returned: 0 in 0.739s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-quobyte-fcd7d63c-f367-4d8f-85ab-23f1665d7947" released by "_delete_snapshot" :: held 3.390s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-quobyte-fa49b6c5-ddc6-44c6-8624-36656037551b" released by "delete_snapshot" :: held 3.424s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:51 devstack cinder-volume[86769]: WARNING cinder.quota [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:11:51 devstack cinder-volume[86769]: DEBUG cinder.quota [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Created reservations ['a4d430ad-0bfc-42e8-a4c2-c633927fe8ec', 'e67cbd8a-38c9-4bb3-95b4-1e9fba9f3542', '7ac12293-3301-4901-8a48-d8d8b68d85cb', 'aefe3e69-a447-4dfe-9596-9e72a874e21c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:11:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Delete snapshot completed successfully. Jul 07 09:11:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-0c082713-675f-4b4f-b6d5-b4121f100cc4 req-4be2b1b6-6b00-48e9-9b56-4a1936b10d57 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-fcd7d63c-f367-4d8f-85ab-23f1665d7947-delete_snapshot" released by "delete_snapshot" :: held 3.640s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "cinder-fa49b6c5-ddc6-44c6-8624-36656037551b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-fa49b6c5-ddc6-44c6-8624-36656037551b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "cinder-quobyte-fa49b6c5-ddc6-44c6-8624-36656037551b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:11:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-quobyte-fa49b6c5-ddc6-44c6-8624-36656037551b" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:11:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a214d-78e4-44f2-8de6-9e1357c73732]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:11:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:52 devstack sudo[89272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b Jul 07 09:11:52 devstack sudo[89272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:53 devstack sudo[89272]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b" returned: 0 in 1.121s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:53 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b Jul 07 09:11:53 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Flow 'volume_create_manager' (a9fdb02c-221b-4d50-85cb-4a70b699062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72c4942-4b3c-4ce8-9908-7634a18ee0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72c4942-4b3c-4ce8-9908-7634a18ee0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1145067925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e6801c-1f25-4b01-adeb-222718d878b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47967ee195446b988060c881b8956d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:11:55Z,use_quota=True,user_id='d3882d9f00454b34a3825ed15d1d632c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27d9684-67cd-4062-8e79-44ac62802d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a27d9684-67cd-4062-8e79-44ac62802d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b34e71-a98d-4d72-8aea-a80db90841ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04b34e71-a98d-4d72-8aea-a80db90841ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1e6801c-1f25-4b01-adeb-222718d878b0', 'volume_name': 'volume-e1e6801c-1f25-4b01-adeb-222718d878b0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5332fb3-196f-4fc1-a29c-42ad1006b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5332fb3-196f-4fc1-a29c-42ad1006b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7c2d90-fbaf-4376-a67a-c41d9139bd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Volume e1e6801c-1f25-4b01-adeb-222718d878b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1e6801c-1f25-4b01-adeb-222718d878b0', 'volume_size': 1} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1145067925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e6801c-1f25-4b01-adeb-222718d878b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e47967ee195446b988060c881b8956d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:11:55Z,use_quota=True,user_id='d3882d9f00454b34a3825ed15d1d632c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Creating volume e1e6801c-1f25-4b01-adeb-222718d878b0 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:11:54 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:11:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:55 devstack sudo[89286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 1073741824 Jul 07 09:11:55 devstack sudo[89286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:55 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fa49b6c5-ddc6-44c6-8624-36656037551b" returned: 0 in 1.301s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-quobyte-fa49b6c5-ddc6-44c6-8624-36656037551b" released by "delete_volume" :: held 2.530s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG cinder.quota [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Created reservations ['37d70aea-bf27-4483-92df-a110aa3d351d', 'a4883793-bc4b-4a74-9444-37cd968a6177', 'd0e6fb25-2011-451d-8725-931f9068931b', 'ac664326-7ff5-472f-81c8-59e616f36a7a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:55 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:11:55 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:56 devstack sudo[89286]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 1073741824" returned: 0 in 2.004s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:11:57 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 Jul 07 09:11:57 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:11:57 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.806s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:57 devstack cinder-volume[86769]: DEBUG cinder.manager [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:11:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Deleted volume successfully. Jul 07 09:11:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-afc70afc-13f4-4d6a-bc13-b1564fe04f14 req-1777006c-10d4-4971-8601-994cf0a80875 tempest-VolumesSnapshotsTestJSON-1836638741 None] Lock "cinder-fa49b6c5-ddc6-44c6-8624-36656037551b-delete_volume" released by "delete_volume" :: held 4.873s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:11:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-c6eb81d8-6599-4650-8655-bdb699ef0a6c req-0b9c5afd-2d47-4c90-8629-cba4573be7ac tempest-TaggedAttachmentsTest-693579014 None] Terminate volume connection completed successfully. Jul 07 09:11:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-c6eb81d8-6599-4650-8655-bdb699ef0a6c req-0b9c5afd-2d47-4c90-8629-cba4573be7ac tempest-TaggedAttachmentsTest-693579014 None] Deleting attachment 61093002-4806-43f1-978d-9f586a1421ec. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:11:59 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0" returned: 0 in 2.054s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] <== create_volume: return (4157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.162s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c7c2d90-fbaf-4376-a67a-c41d9139bd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e6801c-1f25-4b01-adeb-222718d878b0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f438d3-fcd3-4b8a-86ad-3ed638a646fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:11:59 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Volume volume-e1e6801c-1f25-4b01-adeb-222718d878b0 (e1e6801c-1f25-4b01-adeb-222718d878b0): created successfully Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83f438d3-fcd3-4b8a-86ad-3ed638a646fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:11:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Flow 'volume_create_manager' (a9fdb02c-221b-4d50-85cb-4a70b699062f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:11:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-03aec290-fda1-46d5-9949-32fd3feb326f tempest-ServerRescueNegativeTestJSON-286611169 None] Created volume successfully. Jul 07 09:12:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9f774f88-4c73-4f15-9249-63d7dc44947a tempest-GroupSnapshotsTest-23658098 None] Group tempest-GroupSnapshotsTest-Group-715907681: creating Jul 07 09:12:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9f774f88-4c73-4f15-9249-63d7dc44947a tempest-GroupSnapshotsTest-23658098 None] Group tempest-GroupSnapshotsTest-Group-715907681: created successfully Jul 07 09:12:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9f774f88-4c73-4f15-9249-63d7dc44947a tempest-GroupSnapshotsTest-23658098 None] Create group completed successfully. Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (20b56330-e4b9-43ce-8d1c-676aa5c62c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67581a33-f9d7-4b4f-aed5-78529d5b63bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67581a33-f9d7-4b4f-aed5-78529d5b63bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-340896458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3413f0d8-c8b1-4155-9ec4-8cd7d363ecee,host='devstack@QuobyteHD#QuobyteHD',id=fd8e5fd5-488f-41ec-9f6f-061996105a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:07Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b278a11d-d2c8-443c-a2a0-ddb5ef33e186),volume_type_id=b278a11d-d2c8-443c-a2a0-ddb5ef33e186)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcd2a03-7404-4c88-8bf2-50087693287e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fcd2a03-7404-4c88-8bf2-50087693287e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf71c04-6464-429a-b43b-25ad4b36bc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daf71c04-6464-429a-b43b-25ad4b36bc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd8e5fd5-488f-41ec-9f6f-061996105a6c', 'volume_name': 'volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d3e4d7-f607-4d92-9457-04a37e6a89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43d3e4d7-f607-4d92-9457-04a37e6a89e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7998d98f-82b1-4273-b0b3-c83d76a17feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Volume fd8e5fd5-488f-41ec-9f6f-061996105a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c', 'volume_size': 1} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3413f0d8-c8b1-4155-9ec4-8cd7d363ecee,created_at=2026-07-07T07:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-340896458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3413f0d8-c8b1-4155-9ec4-8cd7d363ecee,host='devstack@QuobyteHD#QuobyteHD',id=fd8e5fd5-488f-41ec-9f6f-061996105a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:07Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b278a11d-d2c8-443c-a2a0-ddb5ef33e186),volume_type_id=b278a11d-d2c8-443c-a2a0-ddb5ef33e186)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Creating volume fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:12:06 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:12:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:06 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c 1073741824 Jul 07 09:12:06 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:07 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c 1073741824" returned: 0 in 0.865s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:07 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:07 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:08 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 0.855s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7998d98f-82b1-4273-b0b3-c83d76a17feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476a434e-0568-49eb-8d46-3ddb2cbd5999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:08 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Volume volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c (fd8e5fd5-488f-41ec-9f6f-061996105a6c): created successfully Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (476a434e-0568-49eb-8d46-3ddb2cbd5999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (20b56330-e4b9-43ce-8d1c-676aa5c62c4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:08 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fbf72dd2-fd15-4264-8643-84ca1cdf04fd tempest-GroupSnapshotsTest-23658098 None] Created volume successfully. Jul 07 09:12:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] GroupSnapshot 558cea7d-a199-4c79-a519-d88cb1080ce4: creating. Jul 07 09:12:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Group snapshot 558cea7d-a199-4c79-a519-d88cb1080ce4: creating. {{(pid=86769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 09:12:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Creating offline snapshot 82032888-d9c4-4d93-80cb-47bf1d9ad2c7 of volume fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:12:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccdcb643-5f44-4d0a-a260-f42f848da163]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:09 devstack sudo[89398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:09 devstack sudo[89398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:10 devstack sudo[89398]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 0.936s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:10 devstack sudo[89424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 1G Jul 07 09:12:10 devstack sudo[89424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:11 devstack sudo[89424]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 1G" returned: 0 in 1.007s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:11 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 Jul 07 09:12:11 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:12 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7" returned: 0 in 0.921s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:12 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:12:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:12 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 Jul 07 09:12:12 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:13 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7" returned: 0 in 1.107s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:13 devstack sudo[89472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info Jul 07 09:12:13 devstack sudo[89472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:14 devstack sudo[89472]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info" returned: 0 in 1.385s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:14 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:12:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:14 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info Jul 07 09:12:14 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:16 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.info" returned: 0 in 1.215s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.713s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0e7a05ad-934c-4e86-875d-fd55880f34a8 tempest-GroupSnapshotsTest-23658098 None] group_snapshot 558cea7d-a199-4c79-a519-d88cb1080ce4: created successfully Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-82032888-d9c4-4d93-80cb-47bf1d9ad2c7-c4c84aa9-6f35-4a48-a22e-97b064a3623d" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-82032888-d9c4-4d93-80cb-47bf1d9ad2c7-c4c84aa9-6f35-4a48-a22e-97b064a3623d" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Creating volume c4c84aa9-6f35-4a48-a22e-97b064a3623d from snapshot 82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-c4c84aa9-6f35-4a48-a22e-97b064a3623d" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-c4c84aa9-6f35-4a48-a22e-97b064a3623d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] snapshot: 82032888-d9c4-4d93-80cb-47bf1d9ad2c7, volume: c4c84aa9-6f35-4a48-a22e-97b064a3623d, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc70aa1-957c-4ae2-a93b-d45a75016757]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:18 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 Jul 07 09:12:18 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:19 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7" returned: 0 in 1.317s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0625e65-d91e-4fb7-975a-65964cc5e57d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:19 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:19 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Acquiring lock "cinder-c0c97c07-be6c-4478-8dab-7d36741bff0e-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Lock "cinder-c0c97c07-be6c-4478-8dab-7d36741bff0e-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Acquiring lock "cinder-quobyte-c0c97c07-be6c-4478-8dab-7d36741bff0e" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Lock "cinder-quobyte-c0c97c07-be6c-4478-8dab-7d36741bff0e" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e643e19e-2c45-471c-a1a3-7d0c04e0c4f6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:20 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e Jul 07 09:12:20 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:20 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 1.315s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:12:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:20 devstack sudo[89566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d Jul 07 09:12:20 devstack sudo[89566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Acquiring lock "cinder-e1e6801c-1f25-4b01-adeb-222718d878b0-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "cinder-e1e6801c-1f25-4b01-adeb-222718d878b0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Acquiring lock "cinder-quobyte-e1e6801c-1f25-4b01-adeb-222718d878b0" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:21 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e" returned: 0 in 1.775s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "cinder-quobyte-e1e6801c-1f25-4b01-adeb-222718d878b0" acquired by "delete_volume" :: waited 0.065s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[22029b80-c251-47b0-8565-46ae338b4121]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:21 devstack sudo[89588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e Jul 07 09:12:21 devstack sudo[89588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:22 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 Jul 07 09:12:22 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:23 devstack sudo[89588]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c0c97c07-be6c-4478-8dab-7d36741bff0e" returned: 0 in 1.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Lock "cinder-quobyte-c0c97c07-be6c-4478-8dab-7d36741bff0e" released by "delete_volume" :: held 3.572s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:23 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Created reservations ['b46c1eb5-934d-4d9a-90e4-3a405d4840a0', '7b8613b8-8ac1-4bd8-9ac0-4d5c684665b9', '088e67dd-fe2e-49b9-9a07-a9dde8d0dcb1', '9c4eb535-72b1-434f-9402-00bd4c5ab343'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:24 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:12:24 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:24 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0" returned: 0 in 2.776s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:24 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0 Jul 07 09:12:24 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:27 devstack sudo[89684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:12:27 devstack sudo[89684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:29 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 4.957s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:29 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:12:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Deleted volume successfully. Jul 07 09:12:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-012d7ce5-b61d-461b-b4ca-d1b6e8bb4bac tempest-TaggedAttachmentsTest-693579014 None] Lock "cinder-c0c97c07-be6c-4478-8dab-7d36741bff0e-delete_volume" released by "delete_volume" :: held 9.539s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:29 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e1e6801c-1f25-4b01-adeb-222718d878b0" returned: 0 in 4.871s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "cinder-quobyte-e1e6801c-1f25-4b01-adeb-222718d878b0" released by "delete_volume" :: held 7.795s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Created reservations ['26f634e8-f701-4805-822d-82902ffa21ef', 'd0af1041-3b21-4b8f-b439-ac7b173fc86a', 'c4205cd2-cb44-43ca-ab4a-c5a0ced46987', '95c98c46-a5a8-4b93-afa7-f6b1a7e525cd'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:31 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:12:31 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:31 devstack sudo[89684]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 5.089s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:32 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:12:32 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:12:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 8 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:12:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:12:34 devstack sudo[89566]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d" returned: 0 in 13.709s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae6d747-0306-4cf1-91ad-96e863cd7a17]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:34 devstack sudo[89734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:34 devstack sudo[89734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:35 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 4.137s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:35 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:12:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Deleted volume successfully. Jul 07 09:12:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4459dbe5-215e-4581-837c-fd08357c2ee1 tempest-ServerRescueNegativeTestJSON-286611169 None] Lock "cinder-e1e6801c-1f25-4b01-adeb-222718d878b0-delete_volume" released by "delete_volume" :: held 13.474s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:36 devstack sudo[89734]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 1.949s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:36 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c, size 1024.00 MB, duration 13.71 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:12:36 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Converted 1024.00 MB image at 74.69 MB/s Jul 07 09:12:36 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:12:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:36 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d Jul 07 09:12:36 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:37 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d" returned: 0 in 0.922s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-c4c84aa9-6f35-4a48-a22e-97b064a3623d" released by "_copy_volume_from_snapshot" :: held 19.428s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-82032888-d9c4-4d93-80cb-47bf1d9ad2c7-c4c84aa9-6f35-4a48-a22e-97b064a3623d" released by "_create_volume_from_snapshot" :: held 19.480s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 19.503s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2c8b0c96-22e6-4dfb-b8d2-b3ddc964e12b tempest-GroupSnapshotsTest-23658098 None] Create group from source-snapshot-558cea7d-a199-4c79-a519-d88cb1080ce4 completed successfully. Jul 07 09:12:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-c4c84aa9-6f35-4a48-a22e-97b064a3623d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-c4c84aa9-6f35-4a48-a22e-97b064a3623d" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:38 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfec8859-a36e-4af2-bb6c-0b4851c4836c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:39 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d Jul 07 09:12:39 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:39 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d" returned: 0 in 0.915s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:39 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d Jul 07 09:12:39 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:40 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c4c84aa9-6f35-4a48-a22e-97b064a3623d" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-c4c84aa9-6f35-4a48-a22e-97b064a3623d" released by "delete_volume" :: held 1.728s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=46,cinder:INSERT=11,cinder:DELETE=2,cinder:UPDATE=47 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=48,cinder:UPDATE=40,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['7e2a4956-60b0-4aea-b969-637874e2580b'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:40 devstack cinder-volume[86769]: WARNING cinder.quota [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1407344072 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1407344072, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:12:40 devstack cinder-volume[86769]: WARNING cinder.quota [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1407344072 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1407344072, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['d87e8eda-d608-4437-8ecc-58e9474927b5', '62d75a55-1ea7-46d6-832b-82674f8f9a54', 'ecdc08c8-0a04-49d2-9bea-14764811cd69', '4337cfd6-f03d-49c0-b627-c1694db8c651'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:40 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:12:40 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] group_snapshot 558cea7d-a199-4c79-a519-d88cb1080ce4: deleting Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] group_snapshot 558cea7d-a199-4c79-a519-d88cb1080ce4: deleting {{(pid=86769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-fd8e5fd5-488f-41ec-9f6f-061996105a6c" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-fd8e5fd5-488f-41ec-9f6f-061996105a6c" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-82032888-d9c4-4d93-80cb-47bf1d9ad2c7" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-82032888-d9c4-4d93-80cb-47bf1d9ad2c7" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Deleting offline snapshot 82032888-d9c4-4d93-80cb-47bf1d9ad2c7 of volume fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] snapshot_file for this snap is: volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a784a4-c942-478b-aaad-e590fe77587e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:41 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.831s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:41 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:12:41 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 Jul 07 09:12:41 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b71f93d8-8ae9-41a6-a982-9acea1631717 tempest-GroupSnapshotsTest-23658098 None] Delete group completed successfully. Jul 07 09:12:42 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7" returned: 0 in 1.005s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:12:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2519b20-cfc4-4d73-b941-c0b7987d2c79]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:42 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:42 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:43 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 0.912s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:43 devstack sudo[89832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 Jul 07 09:12:43 devstack sudo[89832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:44 devstack sudo[89832]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7" returned: 0 in 0.876s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:44 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7 Jul 07 09:12:44 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:45 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c.82032888-d9c4-4d93-80cb-47bf1d9ad2c7" returned: 0 in 0.947s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-82032888-d9c4-4d93-80cb-47bf1d9ad2c7" released by "_delete_snapshot" :: held 3.894s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-fd8e5fd5-488f-41ec-9f6f-061996105a6c" released by "delete_snapshot" :: held 3.930s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:45 devstack cinder-volume[86769]: WARNING cinder.quota [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1407344072 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1407344072, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:12:45 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] Created reservations ['58297279-d26e-44c3-bd80-2cf78f75a301', '7ca966a2-4879-4c59-a92c-b78279d28362', 'e352230b-1c53-416d-bbc5-dc2c2f99e72f', '3ebe7c5d-6f4b-455d-b98e-f72fd77f17d8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-861063e1-3255-498a-a3e4-11e9b6f44bbe tempest-GroupSnapshotsTest-23658098 None] group_snapshot 558cea7d-a199-4c79-a519-d88cb1080ce4: deleted successfully Jul 07 09:12:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-fd8e5fd5-488f-41ec-9f6f-061996105a6c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:12:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-fd8e5fd5-488f-41ec-9f6f-061996105a6c" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:12:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa054df-63c8-4818-a799-6ec344408731]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:46 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:46 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:47 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 0.833s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:47 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c Jul 07 09:12:47 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:47 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fd8e5fd5-488f-41ec-9f6f-061996105a6c" returned: 0 in 0.720s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-fd8e5fd5-488f-41ec-9f6f-061996105a6c" released by "delete_volume" :: held 1.653s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['d64ae3e2-168d-4b08-86d6-93655e8fb4c1'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:48 devstack cinder-volume[86769]: WARNING cinder.db.api [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1407344072'] Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['6acd8f22-3d37-4431-a6c2-1285dc9c2be8', '75078a3d-4b1b-4b5f-a3a6-e672ea1bbefd', '6cef2da4-398a-4f98-a880-57a92ec165ff', '2373ce36-d728-496f-9355-2ff5e90e1c18'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:48 devstack sudo[89880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:12:48 devstack sudo[89880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:48 devstack sudo[89880]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.777s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:48 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:12:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c086d544-7b4f-4a94-b7a4-272166a54a53 tempest-GroupSnapshotsTest-23658098 None] Delete group completed successfully. Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Flow 'volume_create_manager' (c409a711-05ea-44a7-9203-0fca9443f54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61116559-5adc-425b-961b-127f1cf81de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61116559-5adc-425b-961b-127f1cf81de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-222388261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbe9fb6-f93f-4253-8ac5-8f694bbd8927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa5259f6894feb816cfafbcd95e59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:49Z,use_quota=True,user_id='94c7ee32b7114a60bf0dbaec93eb341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6cfeb5-d46e-4931-97c5-7da6bd9aada2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c6cfeb5-d46e-4931-97c5-7da6bd9aada2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9d2507-1f1c-404d-bff7-752a36bd3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea9d2507-1f1c-404d-bff7-752a36bd3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fbe9fb6-f93f-4253-8ac5-8f694bbd8927', 'volume_name': 'volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3bf9ae-5df9-4b41-861e-19a78a20d728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e3bf9ae-5df9-4b41-861e-19a78a20d728) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62511c9f-1207-4013-8ad7-0eeb3d294ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:49 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Volume 6fbe9fb6-f93f-4253-8ac5-8f694bbd8927: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927', 'volume_size': 1} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-222388261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fbe9fb6-f93f-4253-8ac5-8f694bbd8927,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa5259f6894feb816cfafbcd95e59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:49Z,use_quota=True,user_id='94c7ee32b7114a60bf0dbaec93eb341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Creating volume 6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:12:49 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:12:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:49 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 1073741824 Jul 07 09:12:49 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-43311c27-5a10-48c7-afd3-8f79dd0e8165 tempest-GroupSnapshotsTest-23658098 None] Group tempest-GroupSnapshotsTest-Group-2124533175: creating Jul 07 09:12:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-43311c27-5a10-48c7-afd3-8f79dd0e8165 tempest-GroupSnapshotsTest-23658098 None] Group tempest-GroupSnapshotsTest-Group-2124533175: created successfully Jul 07 09:12:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-43311c27-5a10-48c7-afd3-8f79dd0e8165 tempest-GroupSnapshotsTest-23658098 None] Create group completed successfully. Jul 07 09:12:50 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 1073741824" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:50 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 Jul 07 09:12:50 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:51 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" returned: 0 in 0.917s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62511c9f-1207-4013-8ad7-0eeb3d294ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce320d0e-75ee-40b4-9ccd-284180916e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Volume volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 (6fbe9fb6-f93f-4253-8ac5-8f694bbd8927): created successfully Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce320d0e-75ee-40b4-9ccd-284180916e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Flow 'volume_create_manager' (c409a711-05ea-44a7-9203-0fca9443f54c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6e04fd49-7c74-44f1-be8b-81abdc02a24e tempest-AttachVolumeNegativeTest-170750861 None] Created volume successfully. Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (a9b00585-7562-435a-a847-66de2b4acd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3cd435-c147-4aeb-8d66-a204cd69f46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab3cd435-c147-4aeb-8d66-a204cd69f46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1618029034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b55ebf-2cb8-4366-9444-172b5d010abf,host='devstack@QuobyteHD#QuobyteHD',id=ecd5fef5-300a-4fcf-aba3-a5ed1ada1651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:51Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f771e292-276f-4a07-b2bb-20dab90cf47f),volume_type_id=f771e292-276f-4a07-b2bb-20dab90cf47f)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1e058c-07c1-415b-91be-e89df60bf81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1e058c-07c1-415b-91be-e89df60bf81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7814f171-4e0b-4e9c-bd0a-23e8df744580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7814f171-4e0b-4e9c-bd0a-23e8df744580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd5fef5-300a-4fcf-aba3-a5ed1ada1651', 'volume_name': 'volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2789873-b0e8-4f38-8e7c-99c48d64572d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2789873-b0e8-4f38-8e7c-99c48d64572d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b8a9c9-7fb0-4080-a1fa-da89a42c28bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Volume ecd5fef5-300a-4fcf-aba3-a5ed1ada1651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651', 'volume_size': 1} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06b55ebf-2cb8-4366-9444-172b5d010abf,created_at=2026-07-07T07:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1618029034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b55ebf-2cb8-4366-9444-172b5d010abf,host='devstack@QuobyteHD#QuobyteHD',id=ecd5fef5-300a-4fcf-aba3-a5ed1ada1651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:51Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f771e292-276f-4a07-b2bb-20dab90cf47f),volume_type_id=f771e292-276f-4a07-b2bb-20dab90cf47f)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Creating volume ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:12:51 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:12:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:51 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 1073741824 Jul 07 09:12:51 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:52 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 1073741824" returned: 0 in 0.990s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:52 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 Jul 07 09:12:52 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:53 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" returned: 0 in 0.729s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] <== create_volume: return (1776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b8a9c9-7fb0-4080-a1fa-da89a42c28bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e432f6-cab0-47da-a06a-70d2c7461742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Volume volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 (ecd5fef5-300a-4fcf-aba3-a5ed1ada1651): created successfully Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e432f6-cab0-47da-a06a-70d2c7461742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (a9b00585-7562-435a-a847-66de2b4acd4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6a856eef-bfaf-41ed-89bc-4deb082031e3 tempest-GroupSnapshotsTest-23658098 None] Created volume successfully. Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (67a49be5-bc9c-49eb-a162-3214ddf4d416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47249fb0-e0ad-4a54-a6b6-e0ede0d34334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47249fb0-e0ad-4a54-a6b6-e0ede0d34334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880430648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b55ebf-2cb8-4366-9444-172b5d010abf,host='devstack@QuobyteHD#QuobyteHD',id=dda7bd76-4028-41b8-a65b-a18ec76abb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:54Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f771e292-276f-4a07-b2bb-20dab90cf47f),volume_type_id=f771e292-276f-4a07-b2bb-20dab90cf47f)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee30140-db40-4ac7-af86-e9a7bbd3f086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dee30140-db40-4ac7-af86-e9a7bbd3f086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12dc3adf-b9e4-4c61-9b9d-1445d26e50bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12dc3adf-b9e4-4c61-9b9d-1445d26e50bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dda7bd76-4028-41b8-a65b-a18ec76abb91', 'volume_name': 'volume-dda7bd76-4028-41b8-a65b-a18ec76abb91', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92b6ce0-3610-4b60-900c-e546c8143334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f92b6ce0-3610-4b60-900c-e546c8143334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e795aad-ecf9-4e86-9845-2b76264862c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Volume dda7bd76-4028-41b8-a65b-a18ec76abb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dda7bd76-4028-41b8-a65b-a18ec76abb91', 'volume_size': 1} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=06b55ebf-2cb8-4366-9444-172b5d010abf,created_at=2026-07-07T07:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-880430648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=06b55ebf-2cb8-4366-9444-172b5d010abf,host='devstack@QuobyteHD#QuobyteHD',id=dda7bd76-4028-41b8-a65b-a18ec76abb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:12:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:12:54Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f771e292-276f-4a07-b2bb-20dab90cf47f),volume_type_id=f771e292-276f-4a07-b2bb-20dab90cf47f)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Creating volume dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:12:54 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:12:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:54 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 1073741824 Jul 07 09:12:54 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:55 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 1073741824" returned: 0 in 1.172s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:55 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 Jul 07 09:12:55 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:12:56 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91" returned: 0 in 0.828s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] <== create_volume: return (2069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.697s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e795aad-ecf9-4e86-9845-2b76264862c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dda7bd76-4028-41b8-a65b-a18ec76abb91', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e6cc85-d357-4f4e-800b-6e79b799233c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0717c2-0769-4bb0-9b3e-89fa89ddcb80]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:12:56 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Volume volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 (dda7bd76-4028-41b8-a65b-a18ec76abb91): created successfully Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e6cc85-d357-4f4e-800b-6e79b799233c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:12:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (67a49be5-bc9c-49eb-a162-3214ddf4d416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:12:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-91961a78-5632-4aff-9976-d16cee49b6c0 tempest-GroupSnapshotsTest-23658098 None] Created volume successfully. Jul 07 09:12:56 devstack sudo[89929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 Jul 07 09:12:56 devstack sudo[89929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:12:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-601e9878-36f9-4879-bed4-0aa00c73144f tempest-GroupSnapshotsTest-23658098 None] Update group completed successfully. Jul 07 09:12:57 devstack sudo[89929]: pam_unix(sudo:session): session closed for user root Jul 07 09:12:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" returned: 0 in 0.962s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:12:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:12:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '928ef662-f2a4-4541-9860-5f678be514e3', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:12:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-a5445fa1-96fe-4c14-a50e-fc295d5c0a58 req-86282fff-3482-4718-a048-403a2e6e6941 tempest-AttachVolumeNegativeTest-170750861 None] attachment_update completed successfully. Jul 07 09:12:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-245dc6bb-1f88-47a2-8b93-f3c8795f1926 tempest-GroupSnapshotsTest-23658098 None] Update group completed successfully. Jul 07 09:12:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b61ccdb6-270b-46db-9722-1a16412d5c3a tempest-GroupSnapshotsTest-23658098 None] Update group completed successfully. Jul 07 09:13:00 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2a82e0fd-fa58-4eab-b2be-df89c34ff647 tempest-GroupSnapshotsTest-23658098 None] Update group completed successfully. Jul 07 09:13:02 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] GroupSnapshot 151051d6-0157-4967-affe-bd448a3f2a49: creating. Jul 07 09:13:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Group snapshot 151051d6-0157-4967-affe-bd448a3f2a49: creating. {{(pid=86769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 09:13:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Creating offline snapshot 18806c8e-79a7-47be-b8d3-82921978b380 of volume dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:13:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab72e7a-19cb-4031-b021-2a0a61b1b024]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:02 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 Jul 07 09:13:02 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:03 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91" returned: 0 in 0.927s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:03 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 1G Jul 07 09:13:03 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:04 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 1G" returned: 0 in 0.962s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:04 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 Jul 07 09:13:04 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:05 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380" returned: 0 in 0.770s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:05 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:13:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:05 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 Jul 07 09:13:05 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:05 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380" returned: 0 in 0.882s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:06 devstack sudo[90350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info Jul 07 09:13:06 devstack sudo[90350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:06 devstack sudo[90350]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info" returned: 0 in 0.879s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:06 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:13:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:06 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info Jul 07 09:13:06 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:07 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.info" returned: 0 in 0.832s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.389s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Creating offline snapshot 24d809a0-773b-4ab6-81aa-49c745a18853 of volume ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f3301c-b65a-4ff1-97ba-cad20006562b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:07 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 Jul 07 09:13:07 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:08 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" returned: 0 in 0.871s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:08 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 1G Jul 07 09:13:08 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:09 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 1G" returned: 0 in 1.022s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:09 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 Jul 07 09:13:09 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:10 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853" returned: 0 in 0.819s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:10 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:13:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:10 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 Jul 07 09:13:10 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:11 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853" returned: 0 in 0.776s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:11 devstack sudo[90399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info Jul 07 09:13:11 devstack sudo[90399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:12 devstack sudo[90399]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info" returned: 0 in 0.973s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:12 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:13:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:12 devstack sudo[90403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info Jul 07 09:13:12 devstack sudo[90403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:13 devstack sudo[90403]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.info" returned: 0 in 1.035s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.629s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ba81fa96-7450-4ab8-9203-6f04583c3282 tempest-GroupSnapshotsTest-23658098 None] group_snapshot 151051d6-0157-4967-affe-bd448a3f2a49: created successfully Jul 07 09:13:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] group_snapshot 151051d6-0157-4967-affe-bd448a3f2a49: deleting Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] group_snapshot 151051d6-0157-4967-affe-bd448a3f2a49: deleting {{(pid=86769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-dda7bd76-4028-41b8-a65b-a18ec76abb91" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-dda7bd76-4028-41b8-a65b-a18ec76abb91" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-18806c8e-79a7-47be-b8d3-82921978b380" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-18806c8e-79a7-47be-b8d3-82921978b380" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Deleting offline snapshot 18806c8e-79a7-47be-b8d3-82921978b380 of volume dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] snapshot_file for this snap is: volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e82400-5696-4e74-9407-6acdd1c0737f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:14 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 Jul 07 09:13:14 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:15 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380" returned: 0 in 1.144s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dda7bd76-4028-41b8-a65b-a18ec76abb91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:13:15 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f937e8-9e8c-440a-9a8f-deca047ed1d6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:15 devstack sudo[90480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 Jul 07 09:13:15 devstack sudo[90480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:16 devstack sudo[90480]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91" returned: 0 in 0.846s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:16 devstack sudo[90506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 Jul 07 09:13:16 devstack sudo[90506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:17 devstack sudo[90506]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:17 devstack sudo[90511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380 Jul 07 09:13:17 devstack sudo[90511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:18 devstack sudo[90511]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91.18806c8e-79a7-47be-b8d3-82921978b380" returned: 0 in 1.097s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-18806c8e-79a7-47be-b8d3-82921978b380" released by "_delete_snapshot" :: held 4.130s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-dda7bd76-4028-41b8-a65b-a18ec76abb91" released by "delete_snapshot" :: held 4.175s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-24d809a0-773b-4ab6-81aa-49c745a18853" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-24d809a0-773b-4ab6-81aa-49c745a18853" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Deleting offline snapshot 24d809a0-773b-4ab6-81aa-49c745a18853 of volume ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] snapshot_file for this snap is: volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ce30d5-9777-4429-a08c-6780a8c5a20d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:19 devstack sudo[90562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 Jul 07 09:13:19 devstack sudo[90562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:19 devstack sudo[90562]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853" returned: 0 in 1.155s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:13:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c5daeed-69c0-4e3c-9af9-183f13765d6c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:20 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 Jul 07 09:13:20 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:21 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" returned: 0 in 1.643s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:21 devstack sudo[90598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 Jul 07 09:13:21 devstack sudo[90598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:23 devstack sudo[90598]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853" returned: 0 in 1.827s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:23 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853 Jul 07 09:13:23 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=57,cinder:INSERT=8,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:13:24 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651.24d809a0-773b-4ab6-81aa-49c745a18853" returned: 0 in 1.267s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-24d809a0-773b-4ab6-81aa-49c745a18853" released by "_delete_snapshot" :: held 6.103s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" released by "delete_snapshot" :: held 6.149s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:24 devstack cinder-volume[86769]: WARNING cinder.quota [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1820951405 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1820951405, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:13:24 devstack cinder-volume[86769]: WARNING cinder.quota [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1820951405 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1820951405, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:13:25 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['6b18794a-8279-4623-a9b6-531df75b457e', '4d254c2f-5c73-43d4-a677-3deebb9b2954', '83563d07-0857-4991-9af1-a5cc8ef1e49a', '0939bccf-c55a-45b4-9973-5170ed0be198'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:25 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['d1e9fcd8-ba77-4db2-9040-e06c16b5ffc8', 'e49cffed-7416-471a-95af-79585880d90c', 'acc37922-30f5-49a4-b920-ae75f86a1b53', '5f33af16-5f42-4866-8a1c-4dab2f8d9148'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5b426c2f-28b0-48b3-8a10-a957ffb52dd8 tempest-GroupSnapshotsTest-23658098 None] group_snapshot 151051d6-0157-4967-affe-bd448a3f2a49: deleted successfully Jul 07 09:13:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-dda7bd76-4028-41b8-a65b-a18ec76abb91" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-dda7bd76-4028-41b8-a65b-a18ec76abb91" acquired by "delete_volume" :: waited 0.037s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:26 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c500ba35-a43d-41ac-a247-07bdab093c55]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:26 devstack sudo[90632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 Jul 07 09:13:26 devstack sudo[90632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:27 devstack sudo[90632]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91" returned: 0 in 1.117s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:27 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91 Jul 07 09:13:27 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:28 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-dda7bd76-4028-41b8-a65b-a18ec76abb91" returned: 0 in 1.023s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-dda7bd76-4028-41b8-a65b-a18ec76abb91" released by "delete_volume" :: held 2.234s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde4d59c-f84d-4411-8b4e-09165d884f39]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:28 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 Jul 07 09:13:28 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:30 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" returned: 0 in 1.824s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:30 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651 Jul 07 09:13:30 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:31 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" returned: 0 in 1.181s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-ecd5fef5-300a-4fcf-aba3-a5ed1ada1651" released by "delete_volume" :: held 3.069s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:31 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Created reservations ['89bc4868-6d59-4a03-b9c2-2a535b9de06f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:31 devstack cinder-volume[86769]: WARNING cinder.quota [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1820951405 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1820951405, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:13:31 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Created reservations ['6d4bfe9d-d7bb-41a5-b23d-839216f97e5e', '40741a0e-9b84-4740-a908-3a7e96e2f264', '88da6e62-3d5e-4e82-afbe-bc811bc95958', 'c859984c-62b3-4b71-86a1-688b4091864f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Created reservations ['77a7fc7e-7a7d-47ad-b809-8081f98bd469', '925d80d5-3589-4f88-9e47-476a81ca32e5', '74ab5150-2182-49e5-91c6-71114d683787', '6771e7f9-5c90-4bad-aa0d-ff864820a07f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:32 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:13:32 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-64a44f35-6ae4-4918-b4f9-5227294a45ba tempest-GroupSnapshotsTest-23658098 None] Group tempest-GroupSnapshotsTest-Group-424458782: creating Jul 07 09:13:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-64a44f35-6ae4-4918-b4f9-5227294a45ba tempest-GroupSnapshotsTest-23658098 None] Group tempest-GroupSnapshotsTest-Group-424458782: created successfully Jul 07 09:13:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-64a44f35-6ae4-4918-b4f9-5227294a45ba tempest-GroupSnapshotsTest-23658098 None] Create group completed successfully. Jul 07 09:13:33 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.167s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:33 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:13:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-48e2bcdf-53d6-4d3e-a0b6-26adc62e5cda tempest-GroupSnapshotsTest-23658098 None] Delete group completed successfully. Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (1bf46e39-795c-49b7-b693-bcdbb76c6e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f85825-ec85-46cf-b82b-9a94e1a3bffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30f85825-ec85-46cf-b82b-9a94e1a3bffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1196980033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cede46a-d952-462f-a7fb-cf738e105753,host='devstack@QuobyteHD#QuobyteHD',id=742bc5a6-1195-44c5-80c3-9b8411b2d773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:13:35Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c808132a-69bb-44af-bde0-6196a867411c),volume_type_id=c808132a-69bb-44af-bde0-6196a867411c)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724485e5-fb6f-45b8-ad36-7186ff5997b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724485e5-fb6f-45b8-ad36-7186ff5997b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df095e1-b6e2-430f-89b4-e0d3583e6f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8df095e1-b6e2-430f-89b4-e0d3583e6f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '742bc5a6-1195-44c5-80c3-9b8411b2d773', 'volume_name': 'volume-742bc5a6-1195-44c5-80c3-9b8411b2d773', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98804006-563d-447f-a12b-a678fe575b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98804006-563d-447f-a12b-a678fe575b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba74a6f-5ce6-46a0-9eeb-9c38c9c5513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Volume 742bc5a6-1195-44c5-80c3-9b8411b2d773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-742bc5a6-1195-44c5-80c3-9b8411b2d773', 'volume_size': 1} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8cede46a-d952-462f-a7fb-cf738e105753,created_at=2026-07-07T07:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1196980033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8cede46a-d952-462f-a7fb-cf738e105753,host='devstack@QuobyteHD#QuobyteHD',id=742bc5a6-1195-44c5-80c3-9b8411b2d773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a33df7cfffdd41238a7fb881dc55acfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:13:35Z,use_quota=True,user_id='ccc946790ed045d2a83841afbc3c0596',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c808132a-69bb-44af-bde0-6196a867411c),volume_type_id=c808132a-69bb-44af-bde0-6196a867411c)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Creating volume 742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:13:35 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:13:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:35 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 1073741824 Jul 07 09:13:35 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:36 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 1073741824" returned: 0 in 1.265s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:36 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 Jul 07 09:13:36 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:37 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773" returned: 0 in 0.707s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.030s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bba74a6f-5ce6-46a0-9eeb-9c38c9c5513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742bc5a6-1195-44c5-80c3-9b8411b2d773', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6906e7-5874-4a0b-bf1e-7f673dad3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Volume volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 (742bc5a6-1195-44c5-80c3-9b8411b2d773): created successfully Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff6906e7-5874-4a0b-bf1e-7f673dad3765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Flow 'volume_create_manager' (1bf46e39-795c-49b7-b693-bcdbb76c6e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:13:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-23c68edc-cd05-4208-9f6e-a565955053f0 tempest-GroupSnapshotsTest-23658098 None] Created volume successfully. Jul 07 09:13:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] GroupSnapshot 6c9bd0d8-21fc-41ea-9747-ec8d6ab26651: creating. Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Group snapshot 6c9bd0d8-21fc-41ea-9747-ec8d6ab26651: creating. {{(pid=86769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Creating offline snapshot 92912abf-6bdf-4e95-9e86-b92d8715c6b5 of volume 742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36ac907-cdcd-4f1d-bae1-705b186cf75d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:38 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 Jul 07 09:13:38 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:38 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773" returned: 0 in 0.815s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:38 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 1G Jul 07 09:13:38 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:39 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 1G" returned: 0 in 0.861s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:39 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 Jul 07 09:13:39 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:40 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5" returned: 0 in 0.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:40 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:13:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:40 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 Jul 07 09:13:40 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:41 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5" returned: 0 in 0.888s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:41 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=88,cinder:SELECT=75,cinder:INSERT=20,cinder:DELETE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:13:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:41 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info Jul 07 09:13:41 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:41 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info" returned: 0 in 0.722s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:41 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:13:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:41 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info Jul 07 09:13:41 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:42 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.info" returned: 0 in 0.790s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.871s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-29ce8db6-3285-4443-9b4c-6d30c478321e tempest-GroupSnapshotsTest-23658098 None] group_snapshot 6c9bd0d8-21fc-41ea-9747-ec8d6ab26651: created successfully Jul 07 09:13:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] group_snapshot 6c9bd0d8-21fc-41ea-9747-ec8d6ab26651: deleting Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] group_snapshot 6c9bd0d8-21fc-41ea-9747-ec8d6ab26651: deleting {{(pid=86769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-742bc5a6-1195-44c5-80c3-9b8411b2d773" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-742bc5a6-1195-44c5-80c3-9b8411b2d773" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-92912abf-6bdf-4e95-9e86-b92d8715c6b5" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-92912abf-6bdf-4e95-9e86-b92d8715c6b5" acquired by "_delete_snapshot" :: waited 0.104s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Deleting offline snapshot 92912abf-6bdf-4e95-9e86-b92d8715c6b5 of volume 742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] snapshot_file for this snap is: volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[95369225-8e9d-4a2e-a2b2-2ca06e856b24]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:44 devstack sudo[90872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 Jul 07 09:13:44 devstack sudo[90872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Flow 'volume_create_manager' (4061c2ae-229b-4898-842f-b922237335b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997f117b-e10a-4042-942d-3bfd1b152aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (997f117b-e10a-4042-942d-3bfd1b152aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-206900461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b5990-38b7-4767-87dd-316ff6d3ef10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a37900fd984248b58b72d6ff084ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:13:44Z,use_quota=True,user_id='e441b83a382f449b86cac50c2428ee86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8ddf01-fd34-4599-9433-faa72d097f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8ddf01-fd34-4599-9433-faa72d097f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6623be0e-43b5-462d-9a47-210b4b0e10ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6623be0e-43b5-462d-9a47-210b4b0e10ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053b5990-38b7-4767-87dd-316ff6d3ef10', 'volume_name': 'volume-053b5990-38b7-4767-87dd-316ff6d3ef10', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c03c5c-f6d1-441b-978e-6b143bfc8f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c03c5c-f6d1-441b-978e-6b143bfc8f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62e9d23-f76c-431a-afcf-a4b8ffc1e99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:44 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Volume 053b5990-38b7-4767-87dd-316ff6d3ef10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053b5990-38b7-4767-87dd-316ff6d3ef10', 'volume_size': 1} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:13:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-206900461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053b5990-38b7-4767-87dd-316ff6d3ef10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52a37900fd984248b58b72d6ff084ef1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:13:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:13:44Z,use_quota=True,user_id='e441b83a382f449b86cac50c2428ee86',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Creating volume 053b5990-38b7-4767-87dd-316ff6d3ef10 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:13:44 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:13:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:44 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 1073741824 Jul 07 09:13:44 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:45 devstack sudo[90872]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5" returned: 0 in 1.867s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-742bc5a6-1195-44c5-80c3-9b8411b2d773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:13:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[27336165-20d1-4a55-b6b0-bae134096d80]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:46 devstack sudo[90918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 Jul 07 09:13:46 devstack sudo[90918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:46 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 1073741824" returned: 0 in 2.016s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:46 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 Jul 07 09:13:46 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:47 devstack sudo[90918]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773" returned: 0 in 1.191s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:47 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 Jul 07 09:13:47 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:47 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10" returned: 0 in 1.043s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] <== create_volume: return (3153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.156s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c62e9d23-f76c-431a-afcf-a4b8ffc1e99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053b5990-38b7-4767-87dd-316ff6d3ef10', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28e9633-e5d0-41a0-8377-4d0d85a8361f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:13:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Volume volume-053b5990-38b7-4767-87dd-316ff6d3ef10 (053b5990-38b7-4767-87dd-316ff6d3ef10): created successfully Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b28e9633-e5d0-41a0-8377-4d0d85a8361f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:13:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Flow 'volume_create_manager' (4061c2ae-229b-4898-842f-b922237335b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:13:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-25c89b71-7ac8-4de7-962b-7c2e208d0a8b tempest-ServerActionsTestOtherA-287329093 None] Created volume successfully. Jul 07 09:13:48 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5" returned: 0 in 0.998s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:48 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5 Jul 07 09:13:48 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:48 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773.92912abf-6bdf-4e95-9e86-b92d8715c6b5" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-92912abf-6bdf-4e95-9e86-b92d8715c6b5" released by "_delete_snapshot" :: held 5.121s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-742bc5a6-1195-44c5-80c3-9b8411b2d773" released by "delete_snapshot" :: held 5.251s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:49 devstack cinder-volume[86769]: WARNING cinder.quota [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-986516383 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-986516383, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:13:49 devstack cinder-volume[86769]: WARNING cinder.quota [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-986516383 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-986516383, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:13:49 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] Created reservations ['78260d9b-1836-4af3-84bf-9eb6b85c4f34', '6ab08680-4345-4362-a202-285e1a20e581', '9847e94a-11dd-4b68-b49c-6dc59164a08d', 'd2a748f3-08a7-4ef8-bdac-1c5b90de94ca'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8296ad2d-c6e8-475e-be52-b2ead47ea93a tempest-GroupSnapshotsTest-23658098 None] group_snapshot 6c9bd0d8-21fc-41ea-9747-ec8d6ab26651: deleted successfully Jul 07 09:13:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "cinder-quobyte-742bc5a6-1195-44c5-80c3-9b8411b2d773" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:13:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-742bc5a6-1195-44c5-80c3-9b8411b2d773" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:13:50 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[09abdc6e-2192-4fbd-bbc0-ae38284ea892]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:13:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:50 devstack sudo[90983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 Jul 07 09:13:50 devstack sudo[90983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:51 devstack sudo[90983]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773" returned: 0 in 0.966s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:51 devstack sudo[91004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773 Jul 07 09:13:51 devstack sudo[91004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:51 devstack sudo[91004]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-742bc5a6-1195-44c5-80c3-9b8411b2d773" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Lock "cinder-quobyte-742bc5a6-1195-44c5-80c3-9b8411b2d773" released by "delete_volume" :: held 1.858s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:13:51 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['04a87073-0150-46ce-b081-cb772c535b93'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:51 devstack cinder-volume[86769]: WARNING cinder.quota [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-986516383 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-986516383, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Created reservations ['f0591dbb-690e-4410-9732-6b190e7c65ef', 'e022c4fd-fdb7-4191-a9ab-36e0d7a23ab6', '98d01b54-f1fe-4bd5-a829-1cd6aba3b8fb', 'f33c0da1-1bc8-4b70-8914-f3416f0601b0'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:13:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:13:52 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:13:52 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:13:53 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 07 09:13:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.881s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:13:53 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:13:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6060d0be-14cd-4c2f-a9fd-d91f39e86b76 tempest-GroupSnapshotsTest-23658098 None] Delete group completed successfully. Jul 07 09:14:00 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-24cbbebe-1753-43ba-9a27-9c4a9d720246 req-25a01644-cae9-433f-8e4c-db5c39feef4c tempest-AttachVolumeNegativeTest-170750861 None] Terminate volume connection completed successfully. Jul 07 09:14:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-24cbbebe-1753-43ba-9a27-9c4a9d720246 req-25a01644-cae9-433f-8e4c-db5c39feef4c tempest-AttachVolumeNegativeTest-170750861 None] Deleting attachment 928ef662-f2a4-4541-9860-5f678be514e3. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Flow 'volume_create_manager' (bee17cb6-4986-4f05-acb7-88bc4924220c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2612ad-318c-42eb-866e-f0378e17c1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f2612ad-318c-42eb-866e-f0378e17c1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-915245443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69fb0db-a99d-418e-b4be-ca5d82a8881b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ab44fbd67d475abc62e14eae712a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:09Z,use_quota=True,user_id='aea4c8ff1a5740a6b8463b416971897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f519be9-6c23-4e22-b060-aabe39c7f5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f519be9-6c23-4e22-b060-aabe39c7f5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d103ca-7915-4316-8ccb-4fa1b2d93ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77d103ca-7915-4316-8ccb-4fa1b2d93ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69fb0db-a99d-418e-b4be-ca5d82a8881b', 'volume_name': 'volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ac7510-3e54-4e4e-a362-69b963784b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05ac7510-3e54-4e4e-a362-69b963784b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafa8a4b-dc83-4b5e-9a32-12ef3d03cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:09 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Volume e69fb0db-a99d-418e-b4be-ca5d82a8881b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b', 'volume_size': 1} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-915245443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69fb0db-a99d-418e-b4be-ca5d82a8881b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ab44fbd67d475abc62e14eae712a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:09Z,use_quota=True,user_id='aea4c8ff1a5740a6b8463b416971897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Creating volume e69fb0db-a99d-418e-b4be-ca5d82a8881b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:14:09 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:14:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:09 devstack sudo[91169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b 1073741824 Jul 07 09:14:09 devstack sudo[91169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:10 devstack sudo[91169]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b 1073741824" returned: 0 in 0.993s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:10 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b Jul 07 09:14:10 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:11 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b" returned: 0 in 0.894s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.969s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafa8a4b-dc83-4b5e-9a32-12ef3d03cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96af8035-d8f2-40b7-baea-4f797fabd666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Volume volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b (e69fb0db-a99d-418e-b4be-ca5d82a8881b): created successfully Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96af8035-d8f2-40b7-baea-4f797fabd666) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Flow 'volume_create_manager' (bee17cb6-4986-4f05-acb7-88bc4924220c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-bd9313e2-918d-4642-b332-2198947b820c tempest-ServersNegativeTestJSON-351108499 None] Created volume successfully. Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Flow 'volume_create_manager' (f6f38c31-4326-4031-a046-cf48c7753ae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e702704-879f-4ff2-81f9-6e045922bc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e702704-879f-4ff2-81f9-6e045922bc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-181706902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c544823-6a4a-44d9-a262-6077876045e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ab44fbd67d475abc62e14eae712a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:14Z,use_quota=True,user_id='aea4c8ff1a5740a6b8463b416971897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1c5f5f-af26-4ac0-9e8e-aa98971ceaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e1c5f5f-af26-4ac0-9e8e-aa98971ceaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbbae47-00e5-43f2-9407-d60e2c9a2df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbbae47-00e5-43f2-9407-d60e2c9a2df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c544823-6a4a-44d9-a262-6077876045e0', 'volume_name': 'volume-7c544823-6a4a-44d9-a262-6077876045e0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f55d72-dcf8-4c18-aa54-10caefbf3fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f55d72-dcf8-4c18-aa54-10caefbf3fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74422b8e-0dbb-409e-91d3-1cdf5a2d6c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:14 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Volume 7c544823-6a4a-44d9-a262-6077876045e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c544823-6a4a-44d9-a262-6077876045e0', 'volume_size': 1} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-181706902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c544823-6a4a-44d9-a262-6077876045e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1ab44fbd67d475abc62e14eae712a94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:14Z,use_quota=True,user_id='aea4c8ff1a5740a6b8463b416971897b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Creating volume 7c544823-6a4a-44d9-a262-6077876045e0 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:14:14 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:14:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:14 devstack sudo[91180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 1073741824 Jul 07 09:14:14 devstack sudo[91180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:15 devstack sudo[91180]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 1073741824" returned: 0 in 1.295s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:15 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 Jul 07 09:14:15 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:16 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0" returned: 0 in 0.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] <== create_volume: return (2031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74422b8e-0dbb-409e-91d3-1cdf5a2d6c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c544823-6a4a-44d9-a262-6077876045e0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd532c2-884a-4177-ac58-bed26cb68866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:16 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Volume volume-7c544823-6a4a-44d9-a262-6077876045e0 (7c544823-6a4a-44d9-a262-6077876045e0): created successfully Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bd532c2-884a-4177-ac58-bed26cb68866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Flow 'volume_create_manager' (f6f38c31-4326-4031-a046-cf48c7753ae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2fadbba7-aff7-4137-9127-c20f86a3f95c tempest-ServersNegativeTestJSON-351108499 None] Created volume successfully. Jul 07 09:14:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "cinder-7c544823-6a4a-44d9-a262-6077876045e0-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-7c544823-6a4a-44d9-a262-6077876045e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "cinder-quobyte-7c544823-6a4a-44d9-a262-6077876045e0" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-quobyte-7c544823-6a4a-44d9-a262-6077876045e0" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[215fa4e5-c5af-4bf0-86f9-14a66be70f85]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:14:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:18 devstack sudo[91211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 Jul 07 09:14:18 devstack sudo[91211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:19 devstack sudo[91211]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0" returned: 0 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:19 devstack sudo[91216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0 Jul 07 09:14:19 devstack sudo[91216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:19 devstack sudo[91216]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7c544823-6a4a-44d9-a262-6077876045e0" returned: 0 in 0.680s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-quobyte-7c544823-6a4a-44d9-a262-6077876045e0" released by "delete_volume" :: held 1.575s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Created reservations ['2bf45e35-509f-4ac4-b6b6-30dd8a6162b5', 'da101e52-3984-4af7-bc21-8e0fe60f3c3f', '4991e01b-f8b6-4ae9-aea1-734605ddaf60', '99d04a40-c17e-4d23-9ead-38cc0a735dc4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:19 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:14:19 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "cinder-e69fb0db-a99d-418e-b4be-ca5d82a8881b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-e69fb0db-a99d-418e-b4be-ca5d82a8881b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "cinder-quobyte-e69fb0db-a99d-418e-b4be-ca5d82a8881b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-quobyte-e69fb0db-a99d-418e-b4be-ca5d82a8881b" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4eeabf6-3bff-4935-b243-6999c2e58a53]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:20 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:14:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Deleted volume successfully. Jul 07 09:14:20 devstack sudo[91222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b Jul 07 09:14:20 devstack sudo[91222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ec8281e-f09a-4a19-b8c6-2e878ad64385 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-7c544823-6a4a-44d9-a262-6077876045e0-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:21 devstack sudo[91222]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b" returned: 0 in 0.862s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:21 devstack sudo[91228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b Jul 07 09:14:21 devstack sudo[91228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Flow 'volume_create_manager' (546d446f-1551-4b97-94cf-4eb2ba4bd9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:22 devstack sudo[91228]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35313190-237d-44d8-99e8-02836d7f9b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e69fb0db-a99d-418e-b4be-ca5d82a8881b" returned: 0 in 0.803s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35313190-237d-44d8-99e8-02836d7f9b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1434332787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ec986e-7838-41dd-8393-9a686ed53ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15620f64e0274bd2b8bc98b17535c71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:22Z,use_quota=True,user_id='950b9300c6ad4bbda26f050af2c7372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb75b75-4e55-4641-ac53-e38f6ad00695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb75b75-4e55-4641-ac53-e38f6ad00695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdb6db9-38eb-4cd1-a6cb-cfc7294fbca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcdb6db9-38eb-4cd1-a6cb-cfc7294fbca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ec986e-7838-41dd-8393-9a686ed53ae6', 'volume_name': 'volume-75ec986e-7838-41dd-8393-9a686ed53ae6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c2485f-70b5-49c4-9b91-5757378b98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c2485f-70b5-49c4-9b91-5757378b98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945dc2bd-c9d4-4c78-8059-0673f073af35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:22 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Volume 75ec986e-7838-41dd-8393-9a686ed53ae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ec986e-7838-41dd-8393-9a686ed53ae6', 'volume_size': 1} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1434332787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ec986e-7838-41dd-8393-9a686ed53ae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='15620f64e0274bd2b8bc98b17535c71f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:22Z,use_quota=True,user_id='950b9300c6ad4bbda26f050af2c7372e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Creating volume 75ec986e-7838-41dd-8393-9a686ed53ae6 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:14:22 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-quobyte-e69fb0db-a99d-418e-b4be-ca5d82a8881b" released by "delete_volume" :: held 1.826s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:22 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 1073741824 Jul 07 09:14:22 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Created reservations ['d2d26ca1-b31c-4ab7-a779-436db5669217', 'ff680555-16af-4966-b3c0-6cd510d49023', '3a91917b-4e62-425c-a882-e7bd44474fa7', '85af45c2-09ab-4cc2-ba00-36518583a178'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:22 devstack sudo[91233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:14:22 devstack sudo[91233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:23 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 1073741824" returned: 0 in 1.549s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:24 devstack sudo[91254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 Jul 07 09:14:24 devstack sudo[91254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:24 devstack sudo[91233]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.513s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:14:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Deleted volume successfully. Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1b219f0a-2a71-45d1-9559-87a41d7b9e01 tempest-ServersNegativeTestJSON-351108499 None] Lock "cinder-e69fb0db-a99d-418e-b4be-ca5d82a8881b-delete_volume" released by "delete_volume" :: held 3.725s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:24 devstack sudo[91254]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6" returned: 0 in 0.875s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] <== create_volume: return (2542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.548s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (945dc2bd-c9d4-4c78-8059-0673f073af35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ec986e-7838-41dd-8393-9a686ed53ae6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315b62e3-274d-40b0-b494-6feb8506003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=85,cinder:SELECT=68,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:14:24 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Volume volume-75ec986e-7838-41dd-8393-9a686ed53ae6 (75ec986e-7838-41dd-8393-9a686ed53ae6): created successfully Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (315b62e3-274d-40b0-b494-6feb8506003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Flow 'volume_create_manager' (546d446f-1551-4b97-94cf-4eb2ba4bd9d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ea9ed6a4-1eb9-4969-b5f2-1b1249d54158 tempest-VolumeQuotasNegativeTestJSON-299988904 None] Created volume successfully. Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Acquiring lock "cinder-75ec986e-7838-41dd-8393-9a686ed53ae6-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:26 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:14:26 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "cinder-75ec986e-7838-41dd-8393-9a686ed53ae6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Acquiring lock "cinder-quobyte-75ec986e-7838-41dd-8393-9a686ed53ae6" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "cinder-quobyte-75ec986e-7838-41dd-8393-9a686ed53ae6" acquired by "delete_volume" :: waited 0.053s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e3693f-d9f0-412a-9598-6a30fbca85ae]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:14:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:27 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 Jul 07 09:14:27 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:28 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.165s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 8 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:14:28 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6" returned: 0 in 1.196s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:28 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6 Jul 07 09:14:28 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:29 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-75ec986e-7838-41dd-8393-9a686ed53ae6" returned: 0 in 0.742s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "cinder-quobyte-75ec986e-7838-41dd-8393-9a686ed53ae6" released by "delete_volume" :: held 2.031s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Created reservations ['a50821b4-51c9-4e1f-8c99-f368558de3b0', 'ead9a482-7bf6-46ad-bd84-ec37fd127b8c', 'e972fed4-01ca-46a7-b3c6-77e2261cf814', 'b8cc24d5-6aff-45ab-911e-1c1c06cf5fa0'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:29 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:14:29 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:30 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.694s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:30 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:14:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Deleted volume successfully. Jul 07 09:14:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4e8456e8-ef91-4f09-ad2d-5e58a83a11aa tempest-VolumeQuotasNegativeTestJSON-299988904 None] Lock "cinder-75ec986e-7838-41dd-8393-9a686ed53ae6-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3318e836-7a73-45d1-95ba-c7ef7105331f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:14:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:32 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 Jul 07 09:14:32 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:33 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10" returned: 0 in 1.080s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.116s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-053b5990-38b7-4767-87dd-316ff6d3ef10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8c038946-76fe-4f2f-9df1-95c6396376e1', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:14:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-0d7de7cb-0dca-438b-ad47-d0eea0e71dce req-2a7c903c-5643-435e-8d49-ef99b7685560 tempest-ServerActionsTestOtherA-287329093 None] attachment_update completed successfully. Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Flow 'volume_create_manager' (a60205f7-ff60-4715-a795-35232df10547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713501f9-58c0-41ae-b10a-5982b3605cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713501f9-58c0-41ae-b10a-5982b3605cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-546597182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04eb0f9-18e2-4a1d-87f5-2d1aee259d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c862cef7583742aa99ba9fd6a5521835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:40Z,use_quota=True,user_id='16b3b329d3d845fdbc71121b05c78016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b275cf-76cb-4e71-a54c-88cbbac5c8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60b275cf-76cb-4e71-a54c-88cbbac5c8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7018bfe-ef18-4a6b-8491-158b926293f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7018bfe-ef18-4a6b-8491-158b926293f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd04eb0f9-18e2-4a1d-87f5-2d1aee259d40', 'volume_name': 'volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588b65ac-748f-44a1-b704-68e893da4c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588b65ac-748f-44a1-b704-68e893da4c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674de58c-6d46-4298-887f-55058da6ec3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:40 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Volume d04eb0f9-18e2-4a1d-87f5-2d1aee259d40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40', 'volume_size': 1} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-546597182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d04eb0f9-18e2-4a1d-87f5-2d1aee259d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c862cef7583742aa99ba9fd6a5521835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:40Z,use_quota=True,user_id='16b3b329d3d845fdbc71121b05c78016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Creating volume d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:14:40 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:14:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:40 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 1073741824 Jul 07 09:14:40 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:41 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 1073741824" returned: 0 in 1.304s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:41 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=55,cinder:UPDATE=54,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:14:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:41 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 Jul 07 09:14:41 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:42 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40" returned: 0 in 0.741s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (674de58c-6d46-4298-887f-55058da6ec3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ee850-4636-4ae4-8f3d-049cda3d5b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:42 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Volume volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 (d04eb0f9-18e2-4a1d-87f5-2d1aee259d40): created successfully Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (512ee850-4636-4ae4-8f3d-049cda3d5b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Flow 'volume_create_manager' (a60205f7-ff60-4715-a795-35232df10547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cdef701f-bd85-4b6e-b7f6-7c57e6843bc0 tempest-VolumesServicesTestJSON-1345082652 None] Created volume successfully. Jul 07 09:14:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-09283063-e799-4036-aa7f-0dbc86835900 req-35c85df5-69d7-4c01-892f-95cfd8d2d6fa tempest-ServerActionsTestOtherA-287329093 None] Terminate volume connection completed successfully. Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-09283063-e799-4036-aa7f-0dbc86835900 req-35c85df5-69d7-4c01-892f-95cfd8d2d6fa tempest-ServerActionsTestOtherA-287329093 None] Deleting attachment 8c038946-76fe-4f2f-9df1-95c6396376e1. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Acquiring lock "cinder-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Lock "cinder-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Acquiring lock "cinder-quobyte-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Lock "cinder-quobyte-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca619b4a-710c-4bef-bdb7-72adf504ffad]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:14:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:43 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 Jul 07 09:14:43 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:44 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40" returned: 0 in 0.911s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:44 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40 Jul 07 09:14:44 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:45 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Lock "cinder-quobyte-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40" released by "delete_volume" :: held 1.726s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Created reservations ['e9ae2b30-fab4-4b25-988c-005c00f13480', 'c8ff2752-390c-4b92-b4e3-25145ee5644d', 'fa650d55-bf8b-45ca-ad3c-a66413289f33', '30d382ab-3973-4c08-b418-b66dfc267f32'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:45 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:14:45 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2dc40e-8992-411d-b71d-078c0f377019]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:14:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:46 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 Jul 07 09:14:46 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:46 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.943s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:46 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:14:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Deleted volume successfully. Jul 07 09:14:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370b7c0c-d07a-4c21-86d3-ade6b55071d1 tempest-VolumesServicesTestJSON-1345082652 None] Lock "cinder-d04eb0f9-18e2-4a1d-87f5-2d1aee259d40-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:14:46 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10" returned: 0 in 0.964s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-053b5990-38b7-4767-87dd-316ff6d3ef10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9c74b89-7809-4b7f-811d-1eaee34f0f65', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:14:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-09283063-e799-4036-aa7f-0dbc86835900 req-9ed50055-3f54-419f-aa60-730c52d4326a tempest-ServerActionsTestOtherA-287329093 None] attachment_update completed successfully. Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Flow 'volume_create_manager' (5d84f1fe-39e0-43db-881b-9aad8c54c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ca9abd-27d1-41ac-a58e-7af97737dabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ca9abd-27d1-41ac-a58e-7af97737dabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680504222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a600df-fa67-4386-8821-0340e61788b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa5259f6894feb816cfafbcd95e59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:54Z,use_quota=True,user_id='94c7ee32b7114a60bf0dbaec93eb341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4061bd8-a44d-4192-8319-08c781033c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4061bd8-a44d-4192-8319-08c781033c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f994bf-95b7-4a58-a8a4-d54af546a73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8f994bf-95b7-4a58-a8a4-d54af546a73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a600df-fa67-4386-8821-0340e61788b8', 'volume_name': 'volume-e4a600df-fa67-4386-8821-0340e61788b8', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1a737a-c1a3-4301-961e-3d183d7678bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f1a737a-c1a3-4301-961e-3d183d7678bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0468e7d8-dde1-4072-a4df-f285d0dde857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Volume e4a600df-fa67-4386-8821-0340e61788b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a600df-fa67-4386-8821-0340e61788b8', 'volume_size': 1} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:14:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-680504222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a600df-fa67-4386-8821-0340e61788b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa5259f6894feb816cfafbcd95e59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:14:54Z,use_quota=True,user_id='94c7ee32b7114a60bf0dbaec93eb341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Creating volume e4a600df-fa67-4386-8821-0340e61788b8 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:14:54 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:14:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:54 devstack sudo[92387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 1073741824 Jul 07 09:14:54 devstack sudo[92387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:56 devstack sudo[92387]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 1073741824" returned: 0 in 1.704s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:14:56 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 Jul 07 09:14:56 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:14:58 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8" returned: 0 in 1.545s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] <== create_volume: return (3323ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.326s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0468e7d8-dde1-4072-a4df-f285d0dde857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a600df-fa67-4386-8821-0340e61788b8', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245f1d24-3a37-445f-b9a3-a777687018de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:14:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Volume volume-e4a600df-fa67-4386-8821-0340e61788b8 (e4a600df-fa67-4386-8821-0340e61788b8): created successfully Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245f1d24-3a37-445f-b9a3-a777687018de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:14:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Flow 'volume_create_manager' (5d84f1fe-39e0-43db-881b-9aad8c54c660) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:14:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e0629d91-3bec-4734-98d2-22c62e1b61f7 tempest-AttachVolumeNegativeTest-170750861 None] Created volume successfully. Jul 07 09:15:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bbd643-05f8-49bd-a143-824299ea7550]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:02 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 Jul 07 09:15:02 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:03 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8" returned: 0 in 1.308s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.346s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-e4a600df-fa67-4386-8821-0340e61788b8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e311947-1cc9-499e-9ff6-b6547daec6a1', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:15:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-4e87c34a-cc66-4d35-bc44-1408f1e53061 req-80b6b986-aeba-4372-9c87-6848dbf8b199 tempest-AttachVolumeNegativeTest-170750861 None] attachment_update completed successfully. Jul 07 09:15:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-ebd3785d-01df-4ce8-a675-ae9fb1f80069 req-88c58c56-6b57-45ba-b12d-ad8dd8694fe7 tempest-AttachVolumeNegativeTest-170750861 None] Terminate volume connection completed successfully. Jul 07 09:15:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-ebd3785d-01df-4ce8-a675-ae9fb1f80069 req-88c58c56-6b57-45ba-b12d-ad8dd8694fe7 tempest-AttachVolumeNegativeTest-170750861 None] Deleting attachment 1e311947-1cc9-499e-9ff6-b6547daec6a1. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Flow 'volume_create_manager' (b02f196b-df84-41a0-ae5d-a95494f09c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8269a4-d183-43d8-8050-61fe45788a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b8269a4-d183-43d8-8050-61fe45788a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-469947712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00af6b59-9584-448a-878e-2412d0cf1d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910072527d6848a0b6277414af44b7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:14Z,use_quota=True,user_id='308b266e2b834f3db59d09a84dbfdd6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb33a14-e8e2-461e-8683-2b586d14f3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb33a14-e8e2-461e-8683-2b586d14f3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cb94cb-654a-42ff-b953-39d8c8549fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cb94cb-654a-42ff-b953-39d8c8549fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00af6b59-9584-448a-878e-2412d0cf1d44', 'volume_name': 'volume-00af6b59-9584-448a-878e-2412d0cf1d44', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c97e0c1-3827-48ea-84c4-135037d07316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c97e0c1-3827-48ea-84c4-135037d07316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f555bd-13a1-46c1-ae5a-313759bf093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Volume 00af6b59-9584-448a-878e-2412d0cf1d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00af6b59-9584-448a-878e-2412d0cf1d44', 'volume_size': 1} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-469947712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00af6b59-9584-448a-878e-2412d0cf1d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='910072527d6848a0b6277414af44b7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:14Z,use_quota=True,user_id='308b266e2b834f3db59d09a84dbfdd6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Creating volume 00af6b59-9584-448a-878e-2412d0cf1d44 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:15:13 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:15:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:13 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 1073741824 Jul 07 09:15:13 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:15 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 1073741824" returned: 0 in 1.659s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:15 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 Jul 07 09:15:15 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:16 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44" returned: 0 in 0.972s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] <== create_volume: return (2688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.690s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f555bd-13a1-46c1-ae5a-313759bf093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00af6b59-9584-448a-878e-2412d0cf1d44', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de01f1f-b3e3-407f-b6e3-a42e7e81fd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:16 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Volume volume-00af6b59-9584-448a-878e-2412d0cf1d44 (00af6b59-9584-448a-878e-2412d0cf1d44): created successfully Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9de01f1f-b3e3-407f-b6e3-a42e7e81fd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Flow 'volume_create_manager' (b02f196b-df84-41a0-ae5d-a95494f09c4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f3a04f05-3c51-48df-bf04-9a75e6b8588e tempest-AbsoluteLimitsTests-599379854 None] Created volume successfully. Jul 07 09:15:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Acquiring lock "cinder-00af6b59-9584-448a-878e-2412d0cf1d44-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Lock "cinder-00af6b59-9584-448a-878e-2412d0cf1d44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Acquiring lock "cinder-quobyte-00af6b59-9584-448a-878e-2412d0cf1d44" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Lock "cinder-quobyte-00af6b59-9584-448a-878e-2412d0cf1d44" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:17 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d97f1b-1cf7-4465-a12f-56160c2167fd]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:17 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 Jul 07 09:15:17 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:18 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44" returned: 0 in 0.857s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:18 devstack sudo[92613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44 Jul 07 09:15:18 devstack sudo[92613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:19 devstack sudo[92613]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-00af6b59-9584-448a-878e-2412d0cf1d44" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Lock "cinder-quobyte-00af6b59-9584-448a-878e-2412d0cf1d44" released by "delete_volume" :: held 1.651s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Created reservations ['c716a828-b378-4fc3-b30c-bef77a994ade', '76cf44c2-eca7-431a-9175-181a2af1d2f3', '79ca79ce-3bd6-4dbf-941e-f1c44b09e0ba', 'db44eef8-7afc-409f-993a-72a610a13820'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:19 devstack sudo[92617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:15:19 devstack sudo[92617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:19 devstack sudo[92617]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.757s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:15:19 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Deleted volume successfully. Jul 07 09:15:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd86caa5-dabd-4d07-a10b-f0c7adeb3580 tempest-AbsoluteLimitsTests-599379854 None] Lock "cinder-00af6b59-9584-448a-878e-2412d0cf1d44-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-f46288da-8676-4cfd-a668-2ba3cabad3d7 req-e1b7a254-c0cd-4f0c-b4c7-42cf365e0759 tempest-ServerActionsTestOtherA-287329093 None] Terminate volume connection completed successfully. Jul 07 09:15:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-f46288da-8676-4cfd-a668-2ba3cabad3d7 req-e1b7a254-c0cd-4f0c-b4c7-42cf365e0759 tempest-ServerActionsTestOtherA-287329093 None] Deleting attachment d9c74b89-7809-4b7f-811d-1eaee34f0f65. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=38,cinder:UPDATE=40,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Flow 'volume_create_manager' (c41f8735-e45c-4d8c-920e-6ca2c3eb0080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b851cb-4e80-4d5a-9808-6862a2e58e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85b851cb-4e80-4d5a-9808-6862a2e58e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1046483453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd4d35a-67cc-4eaf-b0a4-30063e8d5004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f948cfe6414d1b948041f94c136315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:27Z,use_quota=True,user_id='b4471e186a7e45acb7958007675cc5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf130370-3ebd-4cf7-a9db-dc162a879e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf130370-3ebd-4cf7-a9db-dc162a879e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eeefd7-b9a3-446c-8dab-907b64aa6a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95eeefd7-b9a3-446c-8dab-907b64aa6a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdd4d35a-67cc-4eaf-b0a4-30063e8d5004', 'volume_name': 'volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55769e2-127a-4eeb-89f4-2566af8b73f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b55769e2-127a-4eeb-89f4-2566af8b73f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136fd6a1-3812-4d53-aa3a-edffa7f7a4c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:26 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Volume cdd4d35a-67cc-4eaf-b0a4-30063e8d5004: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004', 'volume_size': 1} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1046483453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdd4d35a-67cc-4eaf-b0a4-30063e8d5004,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f948cfe6414d1b948041f94c136315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:27Z,use_quota=True,user_id='b4471e186a7e45acb7958007675cc5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Creating volume cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:15:26 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:26 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 1073741824 Jul 07 09:15:26 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:26 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:15:26 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:27 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 8 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:15:27 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 1073741824" returned: 0 in 0.975s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:27 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 Jul 07 09:15:27 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:28 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004" returned: 0 in 0.659s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.673s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (136fd6a1-3812-4d53-aa3a-edffa7f7a4c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d066b37-581d-4b80-9a48-a8d4988c1c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:28 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Volume volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 (cdd4d35a-67cc-4eaf-b0a4-30063e8d5004): created successfully Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d066b37-581d-4b80-9a48-a8d4988c1c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Flow 'volume_create_manager' (c41f8735-e45c-4d8c-920e-6ca2c3eb0080) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:28 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-47279ef5-2008-4240-bf99-f50eebaf048e tempest-VolumesTransfersV357Test-408000928 None] Created volume successfully. Jul 07 09:15:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-93e51639-5fb4-4d4b-8262-1a08a81f2129 tempest-VolumesTransfersV357Test-1287123703 None] Transfer volume completed successfully. Jul 07 09:15:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Acquiring lock "cinder-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Acquiring lock "cinder-quobyte-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-quobyte-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004" acquired by "delete_volume" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:30 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8936394d-2b73-49c7-8e78-2ee3d71f9cbd]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:30 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 Jul 07 09:15:30 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:31 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004" returned: 0 in 0.879s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "cinder-053b5990-38b7-4767-87dd-316ff6d3ef10-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:31 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004 Jul 07 09:15:31 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Lock "cinder-053b5990-38b7-4767-87dd-316ff6d3ef10-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "cinder-quobyte-053b5990-38b7-4767-87dd-316ff6d3ef10" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Lock "cinder-quobyte-053b5990-38b7-4767-87dd-316ff6d3ef10" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ceb55-21b7-4a00-b2ed-6f35465c45c3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:31 devstack sudo[92705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 Jul 07 09:15:31 devstack sudo[92705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:32 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-quobyte-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004" released by "delete_volume" :: held 1.643s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Created reservations ['0f54ef0b-5a9f-411f-9d32-3824015ed317', '8f7240b1-fd24-4b1a-bd81-f25b0c8a5a64', '46ec9d42-4c83-4793-96cd-e4cbe1e0ae2b', '11082752-93c5-4c3e-9c85-a90ec8f547a5'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:32 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:15:32 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:32 devstack sudo[92705]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10" returned: 0 in 0.789s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:32 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10 Jul 07 09:15:32 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:33 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:15:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Deleted volume successfully. Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c1d05669-6af3-4764-a214-48c59ea23946 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-cdd4d35a-67cc-4eaf-b0a4-30063e8d5004-delete_volume" released by "delete_volume" :: held 2.653s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:33 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-053b5990-38b7-4767-87dd-316ff6d3ef10" returned: 0 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Lock "cinder-quobyte-053b5990-38b7-4767-87dd-316ff6d3ef10" released by "delete_volume" :: held 1.692s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Created reservations ['b2e32599-3f3c-4451-a8d9-f6fb2747ad46', 'e05712cb-22a2-42ac-92a3-0eb681c6e4dc', '7e5de64e-4023-499a-b82c-d8c524b197d4', '9509635f-3d4b-4093-8e30-cd318b8d63ed'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Flow 'volume_create_manager' (252faee0-c182-4744-a78d-0c632b58d6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d41916-3f92-433e-95f8-c64c958ab0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8d41916-3f92-433e-95f8-c64c958ab0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1418648842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef1b00-b817-4446-9251-b6390a8fb259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f948cfe6414d1b948041f94c136315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:33Z,use_quota=True,user_id='b4471e186a7e45acb7958007675cc5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0721b1-59c9-4b19-b3dd-728124845b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba0721b1-59c9-4b19-b3dd-728124845b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c465dd-0be5-4d16-ad62-ae23d077135f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c465dd-0be5-4d16-ad62-ae23d077135f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49ef1b00-b817-4446-9251-b6390a8fb259', 'volume_name': 'volume-49ef1b00-b817-4446-9251-b6390a8fb259', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e5c83b-93cc-49f5-9102-f8fce590e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12e5c83b-93cc-49f5-9102-f8fce590e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed3b0e1-0253-49fe-ba6f-3244f4d155af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:33 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Volume 49ef1b00-b817-4446-9251-b6390a8fb259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49ef1b00-b817-4446-9251-b6390a8fb259', 'volume_size': 1} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1418648842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49ef1b00-b817-4446-9251-b6390a8fb259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f948cfe6414d1b948041f94c136315',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:33Z,use_quota=True,user_id='b4471e186a7e45acb7958007675cc5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Creating volume 49ef1b00-b817-4446-9251-b6390a8fb259 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:15:33 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:33 devstack sudo[92753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 1073741824 Jul 07 09:15:33 devstack sudo[92753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:33 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:15:33 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:34 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.988s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:15:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Deleted volume successfully. Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58b54dd9-d961-412e-9f18-0b6981f2bea7 tempest-ServerActionsTestOtherA-287329093 None] Lock "cinder-053b5990-38b7-4767-87dd-316ff6d3ef10-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Flow 'volume_create_manager' (932ac94d-a90b-472c-954e-bf85e3d3b2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776c7cbb-eedd-410a-90de-7aca84fca4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (776c7cbb-eedd-410a-90de-7aca84fca4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1354065265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188cbd22-ea02-4046-b19a-9e6b78d3f175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef1c24914864b83897e81bc05f39893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:34Z,use_quota=True,user_id='f7b4468a795342658e1f57cdacf61525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:34 devstack sudo[92753]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b06a80-1f76-4d93-86af-dd1afc30ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b06a80-1f76-4d93-86af-dd1afc30ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60cfe8b-d95d-4750-999e-fc54bc407daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e60cfe8b-d95d-4750-999e-fc54bc407daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188cbd22-ea02-4046-b19a-9e6b78d3f175', 'volume_name': 'volume-188cbd22-ea02-4046-b19a-9e6b78d3f175', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde882f7-e18e-4273-bf9b-4d25ff59e36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde882f7-e18e-4273-bf9b-4d25ff59e36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fe8028-65c1-42b9-b19c-8f8bec5cc65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:34 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Volume 188cbd22-ea02-4046-b19a-9e6b78d3f175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188cbd22-ea02-4046-b19a-9e6b78d3f175', 'volume_size': 1} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 1073741824" returned: 0 in 1.230s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:34 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 Jul 07 09:15:34 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:35 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] <== create_volume: return (2048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1354065265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188cbd22-ea02-4046-b19a-9e6b78d3f175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef1c24914864b83897e81bc05f39893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:34Z,use_quota=True,user_id='f7b4468a795342658e1f57cdacf61525',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Creating volume 188cbd22-ea02-4046-b19a-9e6b78d3f175 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:15:35 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed3b0e1-0253-49fe-ba6f-3244f4d155af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49ef1b00-b817-4446-9251-b6390a8fb259', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcb7910-6b1f-4f35-997e-ffa963110026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:35 devstack sudo[92774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 1073741824 Jul 07 09:15:35 devstack sudo[92774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Volume volume-49ef1b00-b817-4446-9251-b6390a8fb259 (49ef1b00-b817-4446-9251-b6390a8fb259): created successfully Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fcb7910-6b1f-4f35-997e-ffa963110026) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Flow 'volume_create_manager' (252faee0-c182-4744-a78d-0c632b58d6e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-79e39436-8cdb-45d6-8c10-b2e34983d156 tempest-VolumesTransfersV357Test-408000928 None] Created volume successfully. Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Acquiring lock "cinder-49ef1b00-b817-4446-9251-b6390a8fb259-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-49ef1b00-b817-4446-9251-b6390a8fb259-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Acquiring lock "cinder-quobyte-49ef1b00-b817-4446-9251-b6390a8fb259" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-quobyte-49ef1b00-b817-4446-9251-b6390a8fb259" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d000ed3b-137d-4188-845b-255a5604dcea]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:36 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 Jul 07 09:15:36 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:36 devstack sudo[92774]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 1073741824" returned: 0 in 1.303s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:36 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 Jul 07 09:15:36 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:37 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175" returned: 0 in 0.853s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] <== create_volume: return (2251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.256s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2fe8028-65c1-42b9-b19c-8f8bec5cc65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188cbd22-ea02-4046-b19a-9e6b78d3f175', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843287d7-6601-44de-91b0-7eff6ca7333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Volume volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 (188cbd22-ea02-4046-b19a-9e6b78d3f175): created successfully Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (843287d7-6601-44de-91b0-7eff6ca7333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Flow 'volume_create_manager' (932ac94d-a90b-472c-954e-bf85e3d3b2e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-268f92ef-011d-471a-b50a-5ce9bb7da531 tempest-AttachVolumeShelveTestJSON-1347223259 None] Created volume successfully. Jul 07 09:15:37 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259" returned: 0 in 1.502s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:37 devstack sudo[92825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259 Jul 07 09:15:37 devstack sudo[92825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:38 devstack sudo[92825]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-49ef1b00-b817-4446-9251-b6390a8fb259" returned: 0 in 0.663s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-quobyte-49ef1b00-b817-4446-9251-b6390a8fb259" released by "delete_volume" :: held 2.242s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Created reservations ['a7cb49f7-5a33-49fe-a35b-69d855763e65', '1f11d90c-44d5-48aa-a78d-1f8a520ae2e9', '4fcdd5a5-2239-413e-a72b-c2eb4cab547d', '8f47b6d2-3c24-49e7-9dee-09f76fb53394'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:38 devstack sudo[92830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:15:38 devstack sudo[92830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:39 devstack sudo[92830]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.719s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:39 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:15:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Deleted volume successfully. Jul 07 09:15:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cf2be669-c9ca-4444-ab0d-705187c132b7 tempest-VolumesTransfersV357Test-195555923 None] Lock "cinder-49ef1b00-b817-4446-9251-b6390a8fb259-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:15:48 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=62,cinder:DELETE=7,cinder:SELECT=53,cinder:INSERT=12 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=30,cinder:DELETE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Flow 'volume_create_manager' (b83e1d8b-56a7-40af-9cce-cfbba56d6438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07837d6f-0d7c-4660-948b-6b115df4e5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07837d6f-0d7c-4660-948b-6b115df4e5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2131373248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9454f3-e34c-4089-8306-fabb3ad637ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b615cbff157426f83e7b416379e2cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:50Z,use_quota=True,user_id='90e7b6df7c044dfc85b33c88511414ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437de2d2-3f19-4e80-81db-362cb4046419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437de2d2-3f19-4e80-81db-362cb4046419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76118256-6a96-4053-be3f-fa0996ed28b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:49 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76118256-6a96-4053-be3f-fa0996ed28b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d9454f3-e34c-4089-8306-fabb3ad637ec', 'volume_name': 'volume-2d9454f3-e34c-4089-8306-fabb3ad637ec', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c6011e-abc2-47d8-ac09-73f155b2faed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86c6011e-abc2-47d8-ac09-73f155b2faed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0a116d-52b3-4e42-864b-6cfa812a7951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:15:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Volume 2d9454f3-e34c-4089-8306-fabb3ad637ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d9454f3-e34c-4089-8306-fabb3ad637ec', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Trying to clone 2d9454f3-e34c-4089-8306-fabb3ad637ec from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:15:51 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Image download 20.69 MB at 20.69 MB/s Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e9221e-8da0-464d-aabe-128acbb7742b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:51 devstack sudo[92956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD Jul 07 09:15:51 devstack sudo[92956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:52 devstack sudo[92956]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD" returned: 0 in 0.815s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:52 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 is fetched for user 90e7b6df7c044dfc85b33c88511414ec. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:15:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[002a701c-7b97-4fcc-b07f-f21e27264a0b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:52 devstack sudo[92962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD Jul 07 09:15:52 devstack sudo[92962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:53 devstack sudo[92962]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD" returned: 0 in 0.986s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:15:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2131373248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9454f3-e34c-4089-8306-fabb3ad637ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b615cbff157426f83e7b416379e2cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:15:50Z,use_quota=True,user_id='90e7b6df7c044dfc85b33c88511414ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Creating volume 2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:15:53 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:15:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:53 devstack sudo[92967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 1073741824 Jul 07 09:15:53 devstack sudo[92967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:54 devstack sudo[92967]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 1073741824" returned: 0 in 1.259s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:54 devstack sudo[92976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:15:54 devstack sudo[92976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:55 devstack sudo[92976]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 0 in 1.107s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] <== create_volume: return (2428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:15:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.434s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:15:55 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Attempting download of 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume 2d9454f3-e34c-4089-8306-fabb3ad637ec. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:15:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb240762-b205-442c-9d7b-30df129fa741]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:56 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7 Jul 07 09:15:56 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:56 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7" returned: 0 in 0.828s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:56 devstack sudo[93015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7 Jul 07 09:15:56 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:57 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7" returned: 1 in 0.849s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_ki3pe5y7' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:15:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d450222-9b72-4646-bdab-e1c929d53ebc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:15:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:57 devstack sudo[93019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD Jul 07 09:15:57 devstack sudo[93019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:15:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-5907d559-c229-4240-9abc-9e7bc7a9c16e req-6d11f26f-0e34-4d33-a447-ffe91729e7e7 tempest-AttachVolumeShelveTestJSON-1347223259 None] No connector for attachment f0bcb83e-6e0b-4b5f-9c1b-40059cb1d07d; skipping storage backend terminate_connection call. {{(pid=86769) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5022}} Jul 07 09:15:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-5907d559-c229-4240-9abc-9e7bc7a9c16e req-6d11f26f-0e34-4d33-a447-ffe91729e7e7 tempest-AttachVolumeShelveTestJSON-1347223259 None] Deleting attachment f0bcb83e-6e0b-4b5f-9c1b-40059cb1d07d. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:15:58 devstack sudo[93019]: pam_unix(sudo:session): session closed for user root Jul 07 09:15:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD" returned: 0 in 0.828s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:15:58 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 was qcow2, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:15:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:15:58 devstack sudo[93024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:15:58 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:01 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 0 in 2.646s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:01 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_22tgmz0hdevstack@QuobyteHD, size 112.00 MB, duration 2.65 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:16:01 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Converted 112.00 MB image at 42.29 MB/s Jul 07 09:16:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:01 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 1G Jul 07 09:16:01 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:02 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 1G" returned: 0 in 1.030s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d243353-5c38-4e52-a7d6-b04e677b7680]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:02 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:02 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:03 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 0 in 1.179s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:03 devstack sudo[93046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:03 devstack sudo[93046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:04 devstack sudo[93046]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 1 in 0.798s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Downloaded image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume 2d9454f3-e34c-4089-8306-fabb3ad637ec successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 for user 90e7b6df7c044dfc85b33c88511414ec is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Marking volume 2d9454f3-e34c-4089-8306-fabb3ad637ec as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Copying metadata from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 to 2d9454f3-e34c-4089-8306-fabb3ad637ec. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Creating volume glance metadata for volume 2d9454f3-e34c-4089-8306-fabb3ad637ec backed by image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f0a116d-52b3-4e42-864b-6cfa812a7951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9454f3-e34c-4089-8306-fabb3ad637ec', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44cd3d0-0199-4a40-aa95-16f56dfb455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Volume volume-2d9454f3-e34c-4089-8306-fabb3ad637ec (2d9454f3-e34c-4089-8306-fabb3ad637ec): created successfully Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f44cd3d0-0199-4a40-aa95-16f56dfb455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Flow 'volume_create_manager' (b83e1d8b-56a7-40af-9cce-cfbba56d6438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1de3ed86-f3ca-4e01-aa02-ab5047fd4930 tempest-VolumesExtendTest-2061455171 None] Created volume successfully. Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8932da84-9187-4041-8092-03fc6b69228e]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:05 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:05 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:05 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:05 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:05 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:06 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 1 in 0.853s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:16:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 2G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec 2G" returned: 0 in 0.103s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.789s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9bcf94cc-6b72-4d49-97b5-c4238aa2ea7b tempest-VolumesExtendTest-2061455171 None] Extend volume completed successfully. Jul 07 09:16:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-2d9454f3-e34c-4089-8306-fabb3ad637ec-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-2d9454f3-e34c-4089-8306-fabb3ad637ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-quobyte-2d9454f3-e34c-4089-8306-fabb3ad637ec" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-2d9454f3-e34c-4089-8306-fabb3ad637ec" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[621111a2-5990-4b29-b9b8-6eabbb183b6d]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:07 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:07 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Flow 'volume_create_manager' (50c3d263-d651-4d5f-ba6c-c26481acee9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08701449-0dee-4122-8f71-1b9f474f9d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08701449-0dee-4122-8f71-1b9f474f9d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1442005259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b97c63-686d-43d5-9711-116cd139a137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa5259f6894feb816cfafbcd95e59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:16:08Z,use_quota=True,user_id='94c7ee32b7114a60bf0dbaec93eb341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9737fbb4-d688-45a1-b0e8-d75d5534b2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9737fbb4-d688-45a1-b0e8-d75d5534b2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0f8ee3-cefe-4a98-8c4d-83c243c9f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d0f8ee3-cefe-4a98-8c4d-83c243c9f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b97c63-686d-43d5-9711-116cd139a137', 'volume_name': 'volume-78b97c63-686d-43d5-9711-116cd139a137', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d1b0fc-928c-4abd-96f4-6b521a87bfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94d1b0fc-928c-4abd-96f4-6b521a87bfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370f0a97-c6fc-4c39-afb8-f50810d79555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:08 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Volume 78b97c63-686d-43d5-9711-116cd139a137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b97c63-686d-43d5-9711-116cd139a137', 'volume_size': 1} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1442005259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b97c63-686d-43d5-9711-116cd139a137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa5259f6894feb816cfafbcd95e59e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:16:08Z,use_quota=True,user_id='94c7ee32b7114a60bf0dbaec93eb341d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Creating volume 78b97c63-686d-43d5-9711-116cd139a137 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:16:08 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:08 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 1073741824 Jul 07 09:16:08 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:08 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 0 in 0.930s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:08 devstack sudo[93079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:08 devstack sudo[93079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:09 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 1073741824" returned: 0 in 1.005s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:09 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 Jul 07 09:16:09 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:09 devstack sudo[93079]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 1 in 0.807s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:16:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:09 devstack sudo[93089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec Jul 07 09:16:09 devstack sudo[93089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:10 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137" returned: 0 in 0.958s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] <== create_volume: return (2006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:10 devstack sudo[93089]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9454f3-e34c-4089-8306-fabb3ad637ec" returned: 0 in 0.922s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370f0a97-c6fc-4c39-afb8-f50810d79555) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b97c63-686d-43d5-9711-116cd139a137', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbe6862-f3de-4343-bcdc-28b371c87808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-2d9454f3-e34c-4089-8306-fabb3ad637ec" released by "delete_volume" :: held 2.755s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:10 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Volume volume-78b97c63-686d-43d5-9711-116cd139a137 (78b97c63-686d-43d5-9711-116cd139a137): created successfully Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fbe6862-f3de-4343-bcdc-28b371c87808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Flow 'volume_create_manager' (50c3d263-d651-4d5f-ba6c-c26481acee9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3111eab7-e61a-41d0-8f13-d04ccf5c51d1 tempest-AttachVolumeNegativeTest-170750861 None] Created volume successfully. Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Created reservations ['49728b46-427b-4b3a-8a36-bd1146e05f0c', '3ee65e41-22be-4b14-b707-92614f1c60ac', 'c62e1003-59ab-4e83-9f46-7e7c5578725e', '288cfece-67f0-4718-90f2-7797db90ce7d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:10 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:10 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:11 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Deleted volume successfully. Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76861852-73f2-4539-8f6c-f335e093bcd9 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-2d9454f3-e34c-4089-8306-fabb3ad637ec-delete_volume" released by "delete_volume" :: held 3.857s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Flow 'volume_create_manager' (bdaf3b94-0f0a-4900-bcd5-4a8714f21f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35db5ac-271e-4db8-b037-6b16e5bb3a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b35db5ac-271e-4db8-b037-6b16e5bb3a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-292969739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133de2a7-cf4c-4b83-b4f4-82bab79f019d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b615cbff157426f83e7b416379e2cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:16:11Z,use_quota=True,user_id='90e7b6df7c044dfc85b33c88511414ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da909a5-fea9-4ba1-9224-352d834b9534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da909a5-fea9-4ba1-9224-352d834b9534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbc1f80-b384-4837-9930-71d918913cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fbc1f80-b384-4837-9930-71d918913cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '133de2a7-cf4c-4b83-b4f4-82bab79f019d', 'volume_name': 'volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19781fdb-7c76-454b-9ea6-aae31ac2f9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19781fdb-7c76-454b-9ea6-aae31ac2f9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cbbf01-7e00-42c8-90c3-da5421e52adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Volume 133de2a7-cf4c-4b83-b4f4-82bab79f019d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d', 'volume_size': 1} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-292969739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=133de2a7-cf4c-4b83-b4f4-82bab79f019d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b615cbff157426f83e7b416379e2cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:16:11Z,use_quota=True,user_id='90e7b6df7c044dfc85b33c88511414ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Creating volume 133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:16:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:16:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:11 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d 1073741824 Jul 07 09:16:11 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:12 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d 1073741824" returned: 0 in 1.057s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:12 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d Jul 07 09:16:12 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:13 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d" returned: 0 in 0.759s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] <== create_volume: return (1867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.871s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98cbbf01-7e00-42c8-90c3-da5421e52adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6371268-f445-41be-b81c-9ff59145ef27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Volume volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d (133de2a7-cf4c-4b83-b4f4-82bab79f019d): created successfully Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6371268-f445-41be-b81c-9ff59145ef27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Flow 'volume_create_manager' (bdaf3b94-0f0a-4900-bcd5-4a8714f21f53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d14454e0-7e96-440e-a4b6-b893983fbabd tempest-VolumesExtendTest-2061455171 None] Created volume successfully. Jul 07 09:16:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f67249a-de4e-4a34-bf51-aa7f6427d053]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:14 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 Jul 07 09:16:14 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:15 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137" returned: 0 in 0.865s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.521s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Creating offline snapshot bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 of volume 133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-78b97c63-686d-43d5-9711-116cd139a137', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44cec0d5-33d4-4aa2-9f2c-df6be1d4d169', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ebb3b6-abfd-4669-9f83-cad717ae5124]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-250f7338-a541-42d3-9a27-1e6c042d8739 req-dea42117-e48d-4b7b-a9d2-8e9e6b4918b8 tempest-AttachVolumeNegativeTest-170750861 None] attachment_update completed successfully. Jul 07 09:16:15 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d Jul 07 09:16:15 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:16 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d" returned: 0 in 0.822s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:16 devstack sudo[93251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 1G Jul 07 09:16:16 devstack sudo[93251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:17 devstack sudo[93251]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 1G" returned: 0 in 1.443s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:17 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 Jul 07 09:16:17 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:18 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" returned: 0 in 0.815s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:18 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 is being set with open permissions: ugo+rw Jul 07 09:16:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:18 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 Jul 07 09:16:18 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:19 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" returned: 0 in 0.835s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:19 devstack sudo[93700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info Jul 07 09:16:19 devstack sudo[93700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:20 devstack sudo[93700]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info" returned: 0 in 0.959s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:20 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info is being set with open permissions: ugo+rw Jul 07 09:16:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:20 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info Jul 07 09:16:20 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:21 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.info" returned: 0 in 1.039s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.066s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-86e2a709-5066-4cc3-98fd-1e53f13fb701 tempest-VolumesExtendTest-2061455171 None] Create snapshot completed successfully Jul 07 09:16:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:22 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4268eb-240b-45f3-a9c2-175ea4c18533]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:22 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d Jul 07 09:16:22 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:23 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d" returned: 0 in 1.038s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 2G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 2G" returned: 0 in 0.272s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.381s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d778c0f1-97d2-432d-be05-a91507993a51 tempest-VolumesExtendTest-2061455171 None] Extend volume completed successfully. Jul 07 09:16:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-d896ea91-782a-4ee6-ac56-8967959fdfc7 req-6cae95e1-9893-49e7-9520-429b58e99754 tempest-AttachVolumeNegativeTest-170750861 None] Terminate volume connection completed successfully. Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-d896ea91-782a-4ee6-ac56-8967959fdfc7 req-6cae95e1-9893-49e7-9520-429b58e99754 tempest-AttachVolumeNegativeTest-170750861 None] Deleting attachment 44cec0d5-33d4-4aa2-9f2c-df6be1d4d169. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-bcd592c5-9155-42c2-8ba9-16f0dd11d9e1-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Lock "cinder-bcd592c5-9155-42c2-8ba9-16f0dd11d9e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-quobyte-133de2a7-cf4c-4b83-b4f4-82bab79f019d" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-133de2a7-cf4c-4b83-b4f4-82bab79f019d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-quobyte-bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Deleting offline snapshot bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 of volume 133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] snapshot_file for this snap is: volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7358f660-2c4e-4f33-8a8c-9a5a5c8a1bd0]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:25 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 Jul 07 09:16:25 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:25 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" returned: 0 in 0.937s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:16:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29cc18c-9399-40ab-9555-443504a3fd4e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:26 devstack sudo[93756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d Jul 07 09:16:26 devstack sudo[93756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:26 devstack sudo[93763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:26 devstack sudo[93763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:27 devstack sudo[93756]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d" returned: 0 in 1.127s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:27 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 Jul 07 09:16:27 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:28 devstack sudo[93763]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.289s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:16:28 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" returned: 0 in 1.587s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:28 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1 Jul 07 09:16:28 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:30 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d.bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" returned: 0 in 1.452s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-bcd592c5-9155-42c2-8ba9-16f0dd11d9e1" released by "_delete_snapshot" :: held 5.294s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-133de2a7-cf4c-4b83-b4f4-82bab79f019d" released by "delete_snapshot" :: held 5.335s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:30 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Created reservations ['a8cdd663-23d7-4570-87c8-2d05df4db1e9', 'df4bf287-0211-4f82-9383-de29e48ead0d', 'e611d202-5b1d-4eef-b2b4-deefb91ccf70', '415ffaba-a9ca-4add-ac55-abc4ec363415'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Delete snapshot completed successfully. Jul 07 09:16:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dd726199-fef5-4776-a7ed-b17d2ff68bbc tempest-VolumesExtendTest-2061455171 None] Lock "cinder-bcd592c5-9155-42c2-8ba9-16f0dd11d9e1-delete_snapshot" released by "delete_snapshot" :: held 5.637s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-133de2a7-cf4c-4b83-b4f4-82bab79f019d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-133de2a7-cf4c-4b83-b4f4-82bab79f019d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "cinder-quobyte-133de2a7-cf4c-4b83-b4f4-82bab79f019d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-133de2a7-cf4c-4b83-b4f4-82bab79f019d" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:31 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf069db-7d85-40aa-8516-4cfa35a399a3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:31 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d Jul 07 09:16:31 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:32 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d" returned: 0 in 0.870s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:32 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d Jul 07 09:16:32 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:33 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-133de2a7-cf4c-4b83-b4f4-82bab79f019d" returned: 0 in 0.786s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-quobyte-133de2a7-cf4c-4b83-b4f4-82bab79f019d" released by "delete_volume" :: held 1.710s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Created reservations ['5f7ac32b-c836-4bbe-acdf-69137540223b', '51a20607-cff4-4458-acb4-bf97f0381ee5', '2d343d0d-000c-4c45-b507-dcc964089181', 'e814c138-e993-4b0c-93d3-014433288d7f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:33 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:33 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:34 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.809s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:34 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Deleted volume successfully. Jul 07 09:16:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-06c2cfda-7313-4512-9021-c04a6e4a9613 tempest-VolumesExtendTest-2061455171 None] Lock "cinder-133de2a7-cf4c-4b83-b4f4-82bab79f019d-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "cinder-78b97c63-686d-43d5-9711-116cd139a137-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-78b97c63-686d-43d5-9711-116cd139a137-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "cinder-quobyte-78b97c63-686d-43d5-9711-116cd139a137" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-quobyte-78b97c63-686d-43d5-9711-116cd139a137" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a3d1c0-17aa-4069-a547-c19a026317bf]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:35 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 Jul 07 09:16:35 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:36 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137" returned: 0 in 0.822s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:36 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137 Jul 07 09:16:36 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:37 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-78b97c63-686d-43d5-9711-116cd139a137" returned: 0 in 0.687s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-quobyte-78b97c63-686d-43d5-9711-116cd139a137" released by "delete_volume" :: held 1.551s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Created reservations ['f380a090-cd5f-4586-abab-da06623c0507', '8ef949e7-baff-441d-9111-c01a352b3fa0', 'a564dedf-d7ae-4356-992b-ae6040b0931d', '2688495c-187c-4f74-b517-214b6ca15d2e'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:37 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:37 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "cinder-e4a600df-fa67-4386-8821-0340e61788b8-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-e4a600df-fa67-4386-8821-0340e61788b8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "cinder-quobyte-e4a600df-fa67-4386-8821-0340e61788b8" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-quobyte-e4a600df-fa67-4386-8821-0340e61788b8" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:38 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.703s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:38 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Deleted volume successfully. Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b57aed-78aa-4d3f-8938-6139e2f77448]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-429cc3af-605f-4091-8951-5425f3e696cb tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-78b97c63-686d-43d5-9711-116cd139a137-delete_volume" released by "delete_volume" :: held 2.494s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:38 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 Jul 07 09:16:38 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:38 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8" returned: 0 in 0.797s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:38 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8 Jul 07 09:16:38 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:39 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e4a600df-fa67-4386-8821-0340e61788b8" returned: 0 in 0.722s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-quobyte-e4a600df-fa67-4386-8821-0340e61788b8" released by "delete_volume" :: held 1.592s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Created reservations ['c546c593-f87f-442c-a732-a0962e0fc538', '07ab19b3-b95c-4443-aa1e-6e5fe82612b8', '9d3178b2-e983-4ee7-b581-692b73ca52c4', '287922a3-d52b-45bc-8203-c0215f9844b6'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:39 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:39 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "cinder-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "cinder-quobyte-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-quobyte-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:40 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.865s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:40 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Deleted volume successfully. Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1652c672-5eda-4188-a2af-890cc286676b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ba702bab-10bb-423e-bb2d-dd5b722c19f2 tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-e4a600df-fa67-4386-8821-0340e61788b8-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:40 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 Jul 07 09:16:40 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:41 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" returned: 0 in 0.940s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:41 devstack sudo[93922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927 Jul 07 09:16:41 devstack sudo[93922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:42 devstack sudo[93922]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" returned: 0 in 0.746s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-quobyte-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927" released by "delete_volume" :: held 1.757s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Created reservations ['cc184007-16c1-4901-9b4d-fbb56481c95e', '253c2270-c384-471b-ad3d-5447d7705f3f', '9cfe7039-c977-48fb-9d37-aa5407888498', '7582d04f-8902-4da4-9423-5fbdcb3d0c56'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:42 devstack sudo[93941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:42 devstack sudo[93941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:43 devstack sudo[93941]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.839s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:43 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Deleted volume successfully. Jul 07 09:16:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cda519e7-f90f-4967-87c8-26743d7a6b5e tempest-AttachVolumeNegativeTest-170750861 None] Lock "cinder-6fbe9fb6-f93f-4253-8ac5-8f694bbd8927-delete_volume" released by "delete_volume" :: held 3.122s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Flow 'volume_create_manager' (11bbb285-a34b-4968-9896-9d8fe025e9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451ad70d-0c45-4d39-b42d-0d6f3860d67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451ad70d-0c45-4d39-b42d-0d6f3860d67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-225833895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b647ac-89a5-4184-a17d-47773449710b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31545e235854ffcb0510dca15375d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:16:45Z,use_quota=True,user_id='1bbb8c549ae846aa8c113e2b1a8cff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039ae92f-6aa2-4b1d-a930-806ab061392e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (039ae92f-6aa2-4b1d-a930-806ab061392e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c1200a-f6d6-4410-98f3-59923a786b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c1200a-f6d6-4410-98f3-59923a786b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b647ac-89a5-4184-a17d-47773449710b', 'volume_name': 'volume-64b647ac-89a5-4184-a17d-47773449710b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9dcb4c-36f9-4017-b552-969d20c0cd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f9dcb4c-36f9-4017-b552-969d20c0cd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10ce88e-9d85-4652-903c-febb78558145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:44 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Volume 64b647ac-89a5-4184-a17d-47773449710b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b647ac-89a5-4184-a17d-47773449710b', 'volume_size': 1} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:16:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-225833895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b647ac-89a5-4184-a17d-47773449710b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31545e235854ffcb0510dca15375d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:16:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:16:45Z,use_quota=True,user_id='1bbb8c549ae846aa8c113e2b1a8cff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Creating volume 64b647ac-89a5-4184-a17d-47773449710b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:16:44 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:16:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:44 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b 1073741824 Jul 07 09:16:44 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:46 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b 1073741824" returned: 0 in 1.092s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:46 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b Jul 07 09:16:46 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:46 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b" returned: 0 in 0.731s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b10ce88e-9d85-4652-903c-febb78558145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b647ac-89a5-4184-a17d-47773449710b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09f0e23-95cb-4659-b005-1b65c32d8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:16:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Volume volume-64b647ac-89a5-4184-a17d-47773449710b (64b647ac-89a5-4184-a17d-47773449710b): created successfully Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c09f0e23-95cb-4659-b005-1b65c32d8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:16:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Flow 'volume_create_manager' (11bbb285-a34b-4968-9896-9d8fe025e9d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:16:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5266c518-efc4-4889-a235-f2ac67913fcf tempest-AttachVolumeTestJSON-1171211741 None] Created volume successfully. Jul 07 09:16:51 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=76,cinder:SELECT=54,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:16:51 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=68,cinder:UPDATE=58,cinder:INSERT=19,cinder:DELETE=5 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:16:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9286c6b9-38ae-46ef-a486-689a4855e792]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:51 devstack sudo[93989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b Jul 07 09:16:51 devstack sudo[93989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:52 devstack sudo[93989]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b" returned: 0 in 0.876s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.907s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-64b647ac-89a5-4184-a17d-47773449710b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97bd3cea-46cc-4798-8ad8-5dda3fdb0670', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:16:52 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-4c682ae9-a4c8-449f-be97-ce3002307f41 req-b68718b8-6090-4aec-bc4f-e90f9033eafe tempest-AttachVolumeTestJSON-1171211741 None] attachment_update completed successfully. Jul 07 09:16:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Acquiring lock "cinder-188cbd22-ea02-4046-b19a-9e6b78d3f175-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "cinder-188cbd22-ea02-4046-b19a-9e6b78d3f175-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Acquiring lock "cinder-quobyte-188cbd22-ea02-4046-b19a-9e6b78d3f175" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:16:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "cinder-quobyte-188cbd22-ea02-4046-b19a-9e6b78d3f175" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:16:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[420b1da7-99ff-47e1-a298-32992d8548f8]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:16:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:54 devstack sudo[94376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 Jul 07 09:16:54 devstack sudo[94376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:55 devstack sudo[94376]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175" returned: 0 in 0.940s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:55 devstack sudo[94382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175 Jul 07 09:16:55 devstack sudo[94382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:55 devstack sudo[94382]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-188cbd22-ea02-4046-b19a-9e6b78d3f175" returned: 0 in 0.836s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "cinder-quobyte-188cbd22-ea02-4046-b19a-9e6b78d3f175" released by "delete_volume" :: held 1.837s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:16:55 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Created reservations ['57bc79de-0f4b-4d4a-ad13-daa7de7c1e92', '03241794-ff6f-4bfa-8d68-83815a590fbc', '1c111c2a-8bfb-474b-8ad0-3be46aa64752', '924b8936-f2f8-48cc-8925-a23a1267a119'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:16:56 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:16:56 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:16:56 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.857s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:16:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Deleted volume successfully. Jul 07 09:16:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9225db5-32ac-4128-9637-c243f6f1e810 tempest-AttachVolumeShelveTestJSON-1347223259 None] Lock "cinder-188cbd22-ea02-4046-b19a-9e6b78d3f175-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Flow 'volume_create_manager' (31ab4bc1-3a32-48b0-808c-4bff11135ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8f5275-886a-4e54-8e21-6388592f6bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a8f5275-886a-4e54-8e21-6388592f6bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2037466899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8beedaf5-5a26-422c-9eb6-381f751e5008,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f381780eae4406ab433b2080753402f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:06Z,use_quota=True,user_id='bccfc22d595b47b89feeba74ca766d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46443a7b-9caf-449f-80f3-8a982a8d7c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46443a7b-9caf-449f-80f3-8a982a8d7c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61c9dee-42c2-415b-9f1b-4ead176acbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61c9dee-42c2-415b-9f1b-4ead176acbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8beedaf5-5a26-422c-9eb6-381f751e5008', 'volume_name': 'volume-8beedaf5-5a26-422c-9eb6-381f751e5008', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4967a74b-c1b6-4cc0-906b-7ecb8fe5ef9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4967a74b-c1b6-4cc0-906b-7ecb8fe5ef9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fc928e-8995-472e-b010-74ed8eac16c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Volume 8beedaf5-5a26-422c-9eb6-381f751e5008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8beedaf5-5a26-422c-9eb6-381f751e5008', 'volume_size': 1} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2037466899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8beedaf5-5a26-422c-9eb6-381f751e5008,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1f381780eae4406ab433b2080753402f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:06Z,use_quota=True,user_id='bccfc22d595b47b89feeba74ca766d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Creating volume 8beedaf5-5a26-422c-9eb6-381f751e5008 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:17:05 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:17:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:05 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 1073741824 Jul 07 09:17:05 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cf0a41fb-51b5-43ca-90e4-2bf70f3809c5 tempest-GroupsV320Test-1870994627 None] Group tempest-GroupsV320Test-Group-655461624: creating Jul 07 09:17:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cf0a41fb-51b5-43ca-90e4-2bf70f3809c5 tempest-GroupsV320Test-1870994627 None] Group tempest-GroupsV320Test-Group-655461624: created successfully Jul 07 09:17:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cf0a41fb-51b5-43ca-90e4-2bf70f3809c5 tempest-GroupsV320Test-1870994627 None] Create group completed successfully. Jul 07 09:17:06 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 1073741824" returned: 0 in 1.038s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:07 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 Jul 07 09:17:07 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:07 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008" returned: 0 in 0.956s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:17:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.045s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56fc928e-8995-472e-b010-74ed8eac16c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8beedaf5-5a26-422c-9eb6-381f751e5008', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb2602a-3d07-4804-9663-7c9a4c62eb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:08 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Volume volume-8beedaf5-5a26-422c-9eb6-381f751e5008 (8beedaf5-5a26-422c-9eb6-381f751e5008): created successfully Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb2602a-3d07-4804-9663-7c9a4c62eb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Flow 'volume_create_manager' (31ab4bc1-3a32-48b0-808c-4bff11135ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:08 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-6ce740cd-2814-4a72-a64b-16bcc5b34585 req-a7569352-0a2f-4beb-91bb-9843b89dda54 tempest-VolumesGetTestJSON-132339666 None] Created volume successfully. Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Created reservations ['6ebc790e-1310-4d18-bda7-bd4a2f7624b4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:08 devstack sudo[94525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:08 devstack sudo[94525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:09 devstack sudo[94525]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.744s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0a752d9c-7296-4c71-97ee-7ef5edcabfe4 tempest-GroupsV320Test-1870994627 None] Delete group completed successfully. Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Acquiring lock "cinder-8beedaf5-5a26-422c-9eb6-381f751e5008-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Lock "cinder-8beedaf5-5a26-422c-9eb6-381f751e5008-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Acquiring lock "cinder-quobyte-8beedaf5-5a26-422c-9eb6-381f751e5008" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Lock "cinder-quobyte-8beedaf5-5a26-422c-9eb6-381f751e5008" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a462f98f-6012-4965-b622-81151525d55d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:09 devstack sudo[94536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 Jul 07 09:17:09 devstack sudo[94536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:10 devstack sudo[94536]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008" returned: 0 in 0.857s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:10 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008 Jul 07 09:17:10 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:11 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8beedaf5-5a26-422c-9eb6-381f751e5008" returned: 0 in 0.983s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Lock "cinder-quobyte-8beedaf5-5a26-422c-9eb6-381f751e5008" released by "delete_volume" :: held 1.915s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG cinder.quota [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Created reservations ['7dc41a94-2a3f-42cd-8487-eb6e23cf7556', '9f527b82-7ead-4300-b361-2282f4216486', 'fbeacbd5-04ec-4ad4-9aec-43a322924ab5', '0d79f144-754c-4c79-9a8b-cb0154c8e132'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:11 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:11 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:13 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.316s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:13 devstack cinder-volume[86769]: DEBUG cinder.manager [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Deleted volume successfully. Jul 07 09:17:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-bc62ee64-a423-48f5-9c3b-8d224abebdcc req-a0057b46-c189-4d09-ab86-69b4cce7f8da tempest-VolumesGetTestJSON-132339666 None] Lock "cinder-8beedaf5-5a26-422c-9eb6-381f751e5008-delete_volume" released by "delete_volume" :: held 3.715s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Flow 'volume_create_manager' (4a5746b2-9410-427a-bd61-ee28cc7a433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c3765b-a67b-43e7-a0fc-29accfd37a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38c3765b-a67b-43e7-a0fc-29accfd37a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2018343256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d71c008-cf5b-4134-b944-10270de59995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8cc58306a64eefa07d7c42e8d7182d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:19Z,use_quota=True,user_id='88504bf984a1423195beff4430a46648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b10f322d-89e5-4138-9815-e0e41b3202da),volume_type_id=b10f322d-89e5-4138-9815-e0e41b3202da)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329510a3-3492-4272-b14f-96a319e0b11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329510a3-3492-4272-b14f-96a319e0b11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7f9d1c-6cd0-4c21-a9a5-e1cacf93e0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed7f9d1c-6cd0-4c21-a9a5-e1cacf93e0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d71c008-cf5b-4134-b944-10270de59995', 'volume_name': 'volume-0d71c008-cf5b-4134-b944-10270de59995', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e5f37b-6e3b-46c7-9566-606479c19ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e5f37b-6e3b-46c7-9566-606479c19ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f799f33d-ec23-4f7f-af83-2241391563cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Volume 0d71c008-cf5b-4134-b944-10270de59995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d71c008-cf5b-4134-b944-10270de59995', 'volume_size': 1} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2018343256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d71c008-cf5b-4134-b944-10270de59995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a8cc58306a64eefa07d7c42e8d7182d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:19Z,use_quota=True,user_id='88504bf984a1423195beff4430a46648',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b10f322d-89e5-4138-9815-e0e41b3202da),volume_type_id=b10f322d-89e5-4138-9815-e0e41b3202da)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Creating volume 0d71c008-cf5b-4134-b944-10270de59995 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:17:18 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:17:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:18 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 1073741824 Jul 07 09:17:18 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:19 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 1073741824" returned: 0 in 1.088s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:20 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 Jul 07 09:17:20 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:21 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995" returned: 0 in 1.288s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] <== create_volume: return (2454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.462s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f799f33d-ec23-4f7f-af83-2241391563cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d71c008-cf5b-4134-b944-10270de59995', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a010597f-869e-4031-ab11-0b3e32500569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:21 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Volume volume-0d71c008-cf5b-4134-b944-10270de59995 (0d71c008-cf5b-4134-b944-10270de59995): created successfully Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a010597f-869e-4031-ab11-0b3e32500569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Flow 'volume_create_manager' (4a5746b2-9410-427a-bd61-ee28cc7a433e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fd1d9051-85d5-4072-860c-5929b3425bb9 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Created volume successfully. Jul 07 09:17:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:22 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:22 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:23 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.127s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b2d561d3-7398-482e-befd-cadfc38a9503 tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Retype volume completed successfully. Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Acquiring lock "cinder-0d71c008-cf5b-4134-b944-10270de59995-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "cinder-0d71c008-cf5b-4134-b944-10270de59995-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Acquiring lock "cinder-quobyte-0d71c008-cf5b-4134-b944-10270de59995" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "cinder-quobyte-0d71c008-cf5b-4134-b944-10270de59995" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[79808a8c-17b6-4371-85be-e13b40f11911]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:24 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 Jul 07 09:17:24 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:25 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995" returned: 0 in 1.357s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:25 devstack sudo[95051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995 Jul 07 09:17:25 devstack sudo[95051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f3a15f8b-85c6-4777-a8cf-cbf9d2e6f181 tempest-GroupSnapshotsV319Test-1289558140 None] Group tempest-GroupSnapshotsV319Test-Group-2098605736: creating Jul 07 09:17:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f3a15f8b-85c6-4777-a8cf-cbf9d2e6f181 tempest-GroupSnapshotsV319Test-1289558140 None] Group tempest-GroupSnapshotsV319Test-Group-2098605736: created successfully Jul 07 09:17:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f3a15f8b-85c6-4777-a8cf-cbf9d2e6f181 tempest-GroupSnapshotsV319Test-1289558140 None] Create group completed successfully. Jul 07 09:17:26 devstack sudo[95051]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0d71c008-cf5b-4134-b944-10270de59995" returned: 0 in 0.884s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "cinder-quobyte-0d71c008-cf5b-4134-b944-10270de59995" released by "delete_volume" :: held 2.320s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:26 devstack cinder-volume[86769]: WARNING cinder.quota [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:17:26 devstack cinder-volume[86769]: WARNING cinder.quota [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Created reservations ['b2a5f209-eadc-402f-9f57-eea169d3a349', '0733ac01-dc71-483c-a4ea-b1664d173aa2', '294b38f8-bd93-4397-95f2-9bca53ee0f94', 'e4c1f633-055d-42b9-b7c7-71ec67270017'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:26 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:26 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:27 devstack sudo[95062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:27 devstack sudo[95062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:27 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.318s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Deleted volume successfully. Jul 07 09:17:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d65c65c1-7941-4225-ae5f-3e09a8e4ba4f tempest-VolumeRetypeWithoutMigrationTest-1594695543 None] Lock "cinder-0d71c008-cf5b-4134-b944-10270de59995-delete_volume" released by "delete_volume" :: held 3.991s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Flow 'volume_create_manager' (bdbddfc5-cf56-4b8e-b291-96929c2c6b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c9c834-70b4-4647-a9bf-6c149227d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4c9c834-70b4-4647-a9bf-6c149227d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-409908076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c350d18-9b1f-45c1-b26e-5b2649145d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e27da0956ab4acf877068e254365f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:28Z,use_quota=True,user_id='cb29f89e2191475497e9f0a7760ae64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73010601-6b5c-4567-a6b4-d99da414581b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack sudo[95062]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73010601-6b5c-4567-a6b4-d99da414581b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9eb3e9-dd06-4f0a-ac7d-e96d65878da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9eb3e9-dd06-4f0a-ac7d-e96d65878da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c350d18-9b1f-45c1-b26e-5b2649145d9d', 'volume_name': 'volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73813cf-6959-454a-97eb-8ea67409d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73813cf-6959-454a-97eb-8ea67409d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32540e51-9960-4940-b985-f8aa76f6d03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Volume 8c350d18-9b1f-45c1-b26e-5b2649145d9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d', 'volume_size': 1} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-409908076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c350d18-9b1f-45c1-b26e-5b2649145d9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e27da0956ab4acf877068e254365f8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:28Z,use_quota=True,user_id='cb29f89e2191475497e9f0a7760ae64f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Creating volume 8c350d18-9b1f-45c1-b26e-5b2649145d9d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:17:28 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:17:28 devstack sudo[95069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d 1073741824 Jul 07 09:17:28 devstack sudo[95069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Flow 'volume_create_manager' (a008d650-ed9d-4c5f-9737-dfaed7c2aa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f6a270-2878-4d6f-bcc6-af359d6815ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.327s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f6a270-2878-4d6f-bcc6-af359d6815ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1702424570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46ec6f9d-ea1e-440b-94ea-19769d5a266a,host='devstack@QuobyteHD#QuobyteHD',id=1ff5c9e0-f70f-4985-89e7-4df8d672f321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e104b577cae4c73a443d39fa5d66760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:28Z,use_quota=True,user_id='1fd1de3368a54902b49b8c99698ac6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb1554ff-7c9d-43e2-8c94-6af4f877d95e),volume_type_id=fb1554ff-7c9d-43e2-8c94-6af4f877d95e)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6216917d-c9ac-471c-a878-6462ecea5187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6216917d-c9ac-471c-a878-6462ecea5187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0485bc1a-f861-493b-b7ef-abad5b4f81f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0485bc1a-f861-493b-b7ef-abad5b4f81f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff5c9e0-f70f-4985-89e7-4df8d672f321', 'volume_name': 'volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b37a39-c409-4357-8b80-714ace3c6156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b37a39-c409-4357-8b80-714ace3c6156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec65bd6b-f3b8-48cd-bfb8-b0dd32ddb89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:28 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Volume 1ff5c9e0-f70f-4985-89e7-4df8d672f321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321', 'volume_size': 1} Jul 07 09:17:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:29 devstack sudo[95069]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d 1073741824" returned: 0 in 0.976s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:29 devstack sudo[95100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d Jul 07 09:17:29 devstack sudo[95100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:30 devstack sudo[95100]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d" returned: 0 in 0.831s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.728s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=46ec6f9d-ea1e-440b-94ea-19769d5a266a,created_at=2026-07-07T07:17:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1702424570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=46ec6f9d-ea1e-440b-94ea-19769d5a266a,host='devstack@QuobyteHD#QuobyteHD',id=1ff5c9e0-f70f-4985-89e7-4df8d672f321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e104b577cae4c73a443d39fa5d66760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:28Z,use_quota=True,user_id='1fd1de3368a54902b49b8c99698ac6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb1554ff-7c9d-43e2-8c94-6af4f877d95e),volume_type_id=fb1554ff-7c9d-43e2-8c94-6af4f877d95e)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Creating volume 1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:17:30 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32540e51-9960-4940-b985-f8aa76f6d03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afa8d9e-f658-4bee-b0c3-b3199ce90429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:30 devstack sudo[95119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 1073741824 Jul 07 09:17:30 devstack sudo[95119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:30 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Volume volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d (8c350d18-9b1f-45c1-b26e-5b2649145d9d): created successfully Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5afa8d9e-f658-4bee-b0c3-b3199ce90429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Flow 'volume_create_manager' (bdbddfc5-cf56-4b8e-b291-96929c2c6b57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-adbfddf3-2f55-46be-9a83-052390264828 tempest-TestMinimumBasicScenario-1261222034 None] Created volume successfully. Jul 07 09:17:31 devstack sudo[95119]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 1073741824" returned: 0 in 1.157s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:31 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 Jul 07 09:17:31 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:32 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321" returned: 0 in 0.782s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] <== create_volume: return (1982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec65bd6b-f3b8-48cd-bfb8-b0dd32ddb89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8675f80-128f-4c98-9d18-7d806fb58e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:32 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Volume volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 (1ff5c9e0-f70f-4985-89e7-4df8d672f321): created successfully Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8675f80-128f-4c98-9d18-7d806fb58e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Flow 'volume_create_manager' (a008d650-ed9d-4c5f-9737-dfaed7c2aa14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c096515d-01df-4b17-be8c-4b17e13b3320 tempest-GroupSnapshotsV319Test-1289558140 None] Created volume successfully. Jul 07 09:17:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] GroupSnapshot af3d07eb-5b16-4f54-b56e-995428de7f3f: creating. Jul 07 09:17:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Group snapshot af3d07eb-5b16-4f54-b56e-995428de7f3f: creating. {{(pid=86769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 07 09:17:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Creating offline snapshot 7ec67a3d-8364-430b-810a-489c3392702a of volume 1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:17:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d54bc-c3ad-4583-bb57-0980864d798a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:33 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 Jul 07 09:17:33 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:34 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321" returned: 0 in 1.339s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:34 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a 1G Jul 07 09:17:34 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Flow 'volume_create_manager' (49822264-37e5-43f7-a1a1-1161e8ef05ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edf971c-e9db-426e-b866-f27b7e320bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5edf971c-e9db-426e-b866-f27b7e320bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-239648609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d081e1e7-9af5-4f7e-8105-13eb10339bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2215342afbba41b9bd845020c9ba430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:35Z,use_quota=True,user_id='64535130a1a441ac81ca5e378d26d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57719822-23b3-4c5a-a4df-ac60e52fd247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57719822-23b3-4c5a-a4df-ac60e52fd247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723f31ba-b5d7-4d30-acee-34557e0f7d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (723f31ba-b5d7-4d30-acee-34557e0f7d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd081e1e7-9af5-4f7e-8105-13eb10339bf9', 'volume_name': 'volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bf8bec-cfcb-4bb7-98ff-54f6ace105ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13bf8bec-cfcb-4bb7-98ff-54f6ace105ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c5369e-709b-4ff0-9dea-fd2430e22b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Volume d081e1e7-9af5-4f7e-8105-13eb10339bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9', 'volume_size': 1} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:35 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a 1G" returned: 0 in 0.867s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:35 devstack sudo[95189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a Jul 07 09:17:35 devstack sudo[95189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:36 devstack sudo[95189]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a" returned: 0 in 0.707s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:36 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:17:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:36 devstack sudo[95194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a Jul 07 09:17:36 devstack sudo[95194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:36 devstack sudo[95194]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a" returned: 0 in 0.692s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:36 devstack sudo[95226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info Jul 07 09:17:36 devstack sudo[95226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:37 devstack sudo[95226]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info" returned: 0 in 0.703s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:37 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:17:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:37 devstack sudo[95229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info Jul 07 09:17:37 devstack sudo[95229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:38 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-b7e5347f-e9ac-42f7-ac60-99f400e15c8d req-b4f551de-9bf8-427c-a7c6-98709afa7532 tempest-AttachVolumeTestJSON-1171211741 None] Terminate volume connection completed successfully. Jul 07 09:17:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-b7e5347f-e9ac-42f7-ac60-99f400e15c8d req-b4f551de-9bf8-427c-a7c6-98709afa7532 tempest-AttachVolumeTestJSON-1171211741 None] Deleting attachment 97bd3cea-46cc-4798-8ad8-5dda3fdb0670. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:17:38 devstack sudo[95229]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.info" returned: 0 in 0.677s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.108s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.747s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:38 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e878c2-cdfb-4927-a295-550a5f125b0f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:38 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f5caf3fc-2024-4ef0-b9be-acc480c33253 tempest-GroupSnapshotsV319Test-1289558140 None] group_snapshot af3d07eb-5b16-4f54-b56e-995428de7f3f: created successfully Jul 07 09:17:38 devstack sudo[95235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d Jul 07 09:17:38 devstack sudo[95235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:39 devstack sudo[95235]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d" returned: 0 in 0.859s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.879s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-239648609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d081e1e7-9af5-4f7e-8105-13eb10339bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2215342afbba41b9bd845020c9ba430a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:35Z,use_quota=True,user_id='64535130a1a441ac81ca5e378d26d31f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Creating volume d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:17:39 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] group_snapshot af3d07eb-5b16-4f54-b56e-995428de7f3f: deleting Jul 07 09:17:39 devstack sudo[95241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 1073741824 Jul 07 09:17:39 devstack sudo[95241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] group_snapshot af3d07eb-5b16-4f54-b56e-995428de7f3f: deleting {{(pid=86769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fc3eddc-da0a-41b5-bbd2-2fe980ba1c87', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "cinder-quobyte-1ff5c9e0-f70f-4985-89e7-4df8d672f321" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Lock "cinder-quobyte-1ff5c9e0-f70f-4985-89e7-4df8d672f321" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "cinder-quobyte-7ec67a3d-8364-430b-810a-489c3392702a" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Lock "cinder-quobyte-7ec67a3d-8364-430b-810a-489c3392702a" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Deleting offline snapshot 7ec67a3d-8364-430b-810a-489c3392702a of volume 1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] snapshot_file for this snap is: volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[424eb09f-80a2-4c84-9a9f-8d4a31b8718d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-e5df570c-e2e9-46c6-9014-754a251837b5 req-b083c340-43d6-4da3-b5bd-dd1c5afa4ecb tempest-TestMinimumBasicScenario-1261222034 None] attachment_update completed successfully. Jul 07 09:17:39 devstack sudo[95243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a Jul 07 09:17:39 devstack sudo[95243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:40 devstack sudo[95241]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 1073741824" returned: 0 in 0.977s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:40 devstack sudo[95318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 Jul 07 09:17:40 devstack sudo[95318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:40 devstack sudo[95243]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a" returned: 0 in 0.907s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[25955f15-2132-4526-afa9-f493209cbe61]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:40 devstack sudo[95321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 Jul 07 09:17:40 devstack sudo[95321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:40 devstack sudo[95318]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9" returned: 0 in 0.743s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:17:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59c5369e-709b-4ff0-9dea-fd2430e22b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54510e5-6620-47c3-97f3-40d2738674fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Volume volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 (d081e1e7-9af5-4f7e-8105-13eb10339bf9): created successfully Jul 07 09:17:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c54510e5-6620-47c3-97f3-40d2738674fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Flow 'volume_create_manager' (49822264-37e5-43f7-a1a1-1161e8ef05ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-828029f0-721d-4a68-9628-543d2b074433 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Created volume successfully. Jul 07 09:17:41 devstack sudo[95321]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321" returned: 0 in 0.910s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:41 devstack sudo[95646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a Jul 07 09:17:41 devstack sudo[95646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:42 devstack sudo[95646]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a" returned: 0 in 0.962s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Creating offline snapshot f1fd335a-e222-4eec-98a7-d49d181bb6a3 of volume d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:17:42 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a Jul 07 09:17:42 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf192668-4015-4fa7-b648-8f74ba94e0fa]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:42 devstack sudo[95658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 Jul 07 09:17:42 devstack sudo[95658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:43 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321.7ec67a3d-8364-430b-810a-489c3392702a" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Lock "cinder-quobyte-7ec67a3d-8364-430b-810a-489c3392702a" released by "_delete_snapshot" :: held 3.705s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Lock "cinder-quobyte-1ff5c9e0-f70f-4985-89e7-4df8d672f321" released by "delete_snapshot" :: held 3.741s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:43 devstack cinder-volume[86769]: WARNING cinder.quota [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-868415217 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-868415217, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:17:43 devstack cinder-volume[86769]: WARNING cinder.quota [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-868415217 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-868415217, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:17:43 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] Created reservations ['07c80a8e-0ffc-43d2-9d94-464617a905ec', '289bfd07-7c74-49e8-880e-49c20969c313', 'e0dbb0bb-006b-446d-8e87-fe1f6ec5c95b', '92b4d2cc-bee4-4a68-87ec-ca5d6b4d3764'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:43 devstack sudo[95658]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9" returned: 0 in 0.934s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-bcce01b6-204d-4088-9d35-ab7fa6bf3cba tempest-GroupSnapshotsV319Test-1289558140 None] group_snapshot af3d07eb-5b16-4f54-b56e-995428de7f3f: deleted successfully Jul 07 09:17:43 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 1G Jul 07 09:17:43 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "cinder-quobyte-1ff5c9e0-f70f-4985-89e7-4df8d672f321" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Lock "cinder-quobyte-1ff5c9e0-f70f-4985-89e7-4df8d672f321" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:44 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc839a81-0e76-4a2f-8af7-6bdc089828c3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:44 devstack sudo[95669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 Jul 07 09:17:44 devstack sudo[95669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:44 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 1G" returned: 0 in 1.231s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:44 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 Jul 07 09:17:44 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:45 devstack sudo[95669]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321" returned: 0 in 1.017s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:45 devstack sudo[95682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321 Jul 07 09:17:45 devstack sudo[95682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:45 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3" returned: 0 in 0.953s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:45 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 is being set with open permissions: ugo+rw Jul 07 09:17:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:45 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 Jul 07 09:17:45 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:45 devstack sudo[95682]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-1ff5c9e0-f70f-4985-89e7-4df8d672f321" returned: 0 in 0.883s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Lock "cinder-quobyte-1ff5c9e0-f70f-4985-89e7-4df8d672f321" released by "delete_volume" :: held 1.975s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Created reservations ['abb71010-028e-48d0-9ef1-ee2a4a9987ad'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:46 devstack cinder-volume[86769]: WARNING cinder.quota [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-868415217 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-868415217, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:17:46 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3" returned: 0 in 0.698s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Created reservations ['af1f66df-20e1-48d7-b043-1b38fa9a3125', '98d5d79a-c6cb-4234-ac2c-953722700830', 'e476e609-248d-4487-b69f-a8261b46211c', 'bef4c439-5dd0-4900-a939-2c517b5d66af'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:46 devstack sudo[95694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info Jul 07 09:17:46 devstack sudo[95694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:46 devstack sudo[95703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:46 devstack sudo[95703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:47 devstack sudo[95694]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info" returned: 0 in 0.967s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:47 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info is being set with open permissions: ugo+rw Jul 07 09:17:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:47 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info Jul 07 09:17:47 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:47 devstack sudo[95703]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.908s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:47 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-98fc4291-5543-4c06-b6c3-9d0d0c123b9f tempest-GroupSnapshotsV319Test-1289558140 None] Delete group completed successfully. Jul 07 09:17:48 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.info" returned: 0 in 0.908s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.847s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f616164d-bdf3-474f-b34e-61d9dff8182d tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Create snapshot completed successfully Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "cinder-f1fd335a-e222-4eec-98a7-d49d181bb6a3-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-f1fd335a-e222-4eec-98a7-d49d181bb6a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "cinder-quobyte-d081e1e7-9af5-4f7e-8105-13eb10339bf9" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-quobyte-d081e1e7-9af5-4f7e-8105-13eb10339bf9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "cinder-quobyte-f1fd335a-e222-4eec-98a7-d49d181bb6a3" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-quobyte-f1fd335a-e222-4eec-98a7-d49d181bb6a3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Deleting offline snapshot f1fd335a-e222-4eec-98a7-d49d181bb6a3 of volume d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] snapshot_file for this snap is: volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[229c01b0-b3c0-4941-ae6d-92cc4b9d266f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:49 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 Jul 07 09:17:49 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:50 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3" returned: 0 in 0.978s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:17:50 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[90169d96-73c4-4c58-a141-b07156057393]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:50 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 Jul 07 09:17:50 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:51 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9" returned: 0 in 1.467s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:51 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 Jul 07 09:17:51 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:53 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3" returned: 0 in 1.285s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:53 devstack sudo[95829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3 Jul 07 09:17:53 devstack sudo[95829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:54 devstack sudo[95829]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9.f1fd335a-e222-4eec-98a7-d49d181bb6a3" returned: 0 in 1.145s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=77,cinder:UPDATE=71,cinder:INSERT=14,cinder:DELETE=5 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=77,cinder:UPDATE=73,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-quobyte-f1fd335a-e222-4eec-98a7-d49d181bb6a3" released by "_delete_snapshot" :: held 5.079s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-quobyte-d081e1e7-9af5-4f7e-8105-13eb10339bf9" released by "delete_snapshot" :: held 5.117s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Created reservations ['1703544c-cbe5-40be-894d-c046f13cab94', 'c5f0d594-d567-4ba6-b68a-00bf57f3e0eb', 'ae145794-9372-4b29-bda7-afc067748612', 'd1b0bcb4-3651-4dbf-babe-72de260baf8f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Delete snapshot completed successfully. Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ffc2c25-e306-4b56-9b00-d612764ceb81 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-f1fd335a-e222-4eec-98a7-d49d181bb6a3-delete_snapshot" released by "delete_snapshot" :: held 5.349s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "cinder-d081e1e7-9af5-4f7e-8105-13eb10339bf9-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-d081e1e7-9af5-4f7e-8105-13eb10339bf9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "cinder-quobyte-d081e1e7-9af5-4f7e-8105-13eb10339bf9" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-quobyte-d081e1e7-9af5-4f7e-8105-13eb10339bf9" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e2f502-2b9b-45a0-9fdc-f364348601d1]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:17:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e7098d4c-1167-4d3c-b9f6-c69a730c115c tempest-GroupsV314Test-1614592346 None] Group tempest-GroupsV314Test-Group-555311406: creating Jul 07 09:17:55 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 Jul 07 09:17:55 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e7098d4c-1167-4d3c-b9f6-c69a730c115c tempest-GroupsV314Test-1614592346 None] Group tempest-GroupsV314Test-Group-555311406: created successfully Jul 07 09:17:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e7098d4c-1167-4d3c-b9f6-c69a730c115c tempest-GroupsV314Test-1614592346 None] Create group completed successfully. Jul 07 09:17:55 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9" returned: 0 in 0.836s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:55 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9 Jul 07 09:17:55 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:56 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d081e1e7-9af5-4f7e-8105-13eb10339bf9" returned: 0 in 0.648s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-quobyte-d081e1e7-9af5-4f7e-8105-13eb10339bf9" released by "delete_volume" :: held 1.572s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Created reservations ['a254adc7-e906-4bc3-a23f-d199b4bc4d21', '0eb411e1-eaa0-4d7d-be4f-f3124e604768', 'b8a4da75-7eba-406e-8754-b9fc3234007b', 'e3ee18ad-a78a-4105-afa2-caf343420460'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:56 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:17:56 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Flow 'volume_create_manager' (a3a14cd2-97c1-45bf-881a-b66944c29751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24342c2-6295-4766-a8cb-ca2b1e16ba9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c24342c2-6295-4766-a8cb-ca2b1e16ba9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854777757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7425516f-b56c-4aff-9c48-a1b455af09cd,host='devstack@QuobyteHD#QuobyteHD',id=13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2358a8a928419598c00e61b2ef3994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:57Z,use_quota=True,user_id='211e9487cf02402188aa15c94d3b812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89c5b530-d1e8-4ae6-a463-8409a87548c6),volume_type_id=89c5b530-d1e8-4ae6-a463-8409a87548c6)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d826ff-8861-45eb-b409-5f08f7a362d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2d826ff-8861-45eb-b409-5f08f7a362d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8d58dc-8974-4720-9d7a-2f6d92522c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb8d58dc-8974-4720-9d7a-2f6d92522c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b', 'volume_name': 'volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf35b97-7ec7-4f99-951d-974fe72825bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf35b97-7ec7-4f99-951d-974fe72825bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31da305-674d-4916-9bc6-b35fed636c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:57 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Volume 13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b', 'volume_size': 1} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7425516f-b56c-4aff-9c48-a1b455af09cd,created_at=2026-07-07T07:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1854777757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7425516f-b56c-4aff-9c48-a1b455af09cd,host='devstack@QuobyteHD#QuobyteHD',id=13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c2358a8a928419598c00e61b2ef3994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:17:57Z,use_quota=True,user_id='211e9487cf02402188aa15c94d3b812c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(89c5b530-d1e8-4ae6-a463-8409a87548c6),volume_type_id=89c5b530-d1e8-4ae6-a463-8409a87548c6)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Creating volume 13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:17:57 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:57 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b 1073741824 Jul 07 09:17:57 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:57 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.926s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:17:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Deleted volume successfully. Jul 07 09:17:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f5a4ecf-bf30-441c-a078-18cdc29c78d1 tempest-VolumeSnapshotQuotasNegativeTestJSON-329608932 None] Lock "cinder-d081e1e7-9af5-4f7e-8105-13eb10339bf9-delete_volume" released by "delete_volume" :: held 2.806s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:17:58 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b 1073741824" returned: 0 in 1.181s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:17:58 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:17:58 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:17:59 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.679s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f31da305-674d-4916-9bc6-b35fed636c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e412bb79-eaca-4f55-a4af-4dcabcdbff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:17:59 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Volume volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b (13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b): created successfully Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e412bb79-eaca-4f55-a4af-4dcabcdbff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:17:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Flow 'volume_create_manager' (a3a14cd2-97c1-45bf-881a-b66944c29751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:17:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a259dc09-8944-4b00-b4cd-42d48da52235 tempest-GroupsV314Test-1614592346 None] Created volume successfully. Jul 07 09:18:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:00 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Cloning volume 13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b to volume 8f137e19-91f2-447c-8692-3946e31351d0 Jul 07 09:18:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Creating offline snapshot 856a14d3-b316-4b71-baa4-30043dfc311d of volume 13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:18:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e506f0ac-6399-42ce-87ce-d7ad97d869f6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:01 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:18:01 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:01 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.951s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:02 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d 1G Jul 07 09:18:02 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:03 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d 1G" returned: 0 in 1.052s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:03 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d Jul 07 09:18:03 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:04 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d" returned: 0 in 0.964s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:04 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:04 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d Jul 07 09:18:04 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Flow 'volume_create_manager' (50e102f4-c04f-4b6f-8345-7af94a8133fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b768fd9-9743-4299-8c93-c54cdc110b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b768fd9-9743-4299-8c93-c54cdc110b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-376991965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b9df92-850c-48ea-959e-a2e2c1afd367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7171240bfa234086a68b4d2f454147c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:18:05Z,use_quota=True,user_id='08808ea3e59045a0a49f8d7b91880383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444a207a-6dd7-4ea6-8ebf-87b764cc02db),volume_type_id=444a207a-6dd7-4ea6-8ebf-87b764cc02db)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b9451e-9f6f-4f16-8678-b558141042f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b9451e-9f6f-4f16-8678-b558141042f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:04 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c6248b-8f20-4c18-a7d9-484905493e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6c6248b-8f20-4c18-a7d9-484905493e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2b9df92-850c-48ea-959e-a2e2c1afd367', 'volume_name': 'volume-b2b9df92-850c-48ea-959e-a2e2c1afd367', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e480d5-fb96-49b9-8181-0998dfd35bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e480d5-fb96-49b9-8181-0998dfd35bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcbc1b0-c0b1-42d2-afa7-1a8d153fff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Volume b2b9df92-850c-48ea-959e-a2e2c1afd367: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2b9df92-850c-48ea-959e-a2e2c1afd367', 'volume_size': 1} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:04 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info Jul 07 09:18:04 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:05 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info" returned: 0 in 0.698s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:05 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:18:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:05 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info Jul 07 09:18:05 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:06 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.info" returned: 0 in 0.653s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Acquiring lock "cinder-quobyte-8f137e19-91f2-447c-8692-3946e31351d0" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-8f137e19-91f2-447c-8692-3946e31351d0" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] snapshot: 856a14d3-b316-4b71-baa4-30043dfc311d, volume: 8f137e19-91f2-447c-8692-3946e31351d0, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c4c63-f154-4e8f-9d8e-ea494f852c1e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:06 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d Jul 07 09:18:06 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:07 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204c584-6bac-41e2-a96e-af34ce8c8568]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:07 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:18:07 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:07 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.772s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:18:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:07 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 Jul 07 09:18:07 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:14 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0" returned: 0 in 6.494s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ef17b0-0ee8-4de6-a4f0-1027c4bccd0e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:14 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:18:14 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:14 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:18:14 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=22,cinder:INSERT=5,cinder:UPDATE=15 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:18:15 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.951s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:15 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b, size 1024.00 MB, duration 6.50 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:18:15 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Converted 1024.00 MB image at 157.65 MB/s Jul 07 09:18:15 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 is being set with open permissions: ugo+rw: NotImplementedError Jul 07 09:18:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:15 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 Jul 07 09:18:15 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:16 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0" returned: 0 in 0.754s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-8f137e19-91f2-447c-8692-3946e31351d0" released by "_copy_volume_from_snapshot" :: held 9.859s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Acquiring lock "cinder-quobyte-856a14d3-b316-4b71-baa4-30043dfc311d" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-856a14d3-b316-4b71-baa4-30043dfc311d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Deleting offline snapshot 856a14d3-b316-4b71-baa4-30043dfc311d of volume 13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] snapshot_file for this snap is: volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ef288f-e9b3-4523-bdfb-5fc8b932ac6e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:16 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d Jul 07 09:18:16 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:16 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d" returned: 0 in 0.780s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:18:17 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[286ef1e3-6bc5-4a0f-a15e-96302af476c3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:17 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:18:17 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:18 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.991s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:18 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d Jul 07 09:18:18 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:18 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:18 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d Jul 07 09:18:18 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:19 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b.856a14d3-b316-4b71-baa4-30043dfc311d" returned: 0 in 0.693s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-856a14d3-b316-4b71-baa4-30043dfc311d" released by "_delete_snapshot" :: held 3.353s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.585s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.695s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-376991965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2b9df92-850c-48ea-959e-a2e2c1afd367,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7171240bfa234086a68b4d2f454147c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:18:05Z,use_quota=True,user_id='08808ea3e59045a0a49f8d7b91880383',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(444a207a-6dd7-4ea6-8ebf-87b764cc02db),volume_type_id=444a207a-6dd7-4ea6-8ebf-87b764cc02db)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Creating volume b2b9df92-850c-48ea-959e-a2e2c1afd367 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:18:19 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:18:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:19 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 1073741824 Jul 07 09:18:19 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:19 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-17bad940-a3f2-46d7-bab6-2ae24166abd7 tempest-GroupsV314Test-1614592346 None] Create group from source-group-7425516f-b56c-4aff-9c48-a1b455af09cd completed successfully. Jul 07 09:18:20 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 1073741824" returned: 0 in 0.900s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:20 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 Jul 07 09:18:20 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Acquiring lock "cinder-quobyte-8f137e19-91f2-447c-8692-3946e31351d0" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-8f137e19-91f2-447c-8692-3946e31351d0" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d362455a-8869-483a-94ee-3361910b6994]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:21 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 Jul 07 09:18:21 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:21 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367" returned: 0 in 0.735s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] <== create_volume: return (1676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fcbc1b0-c0b1-42d2-afa7-1a8d153fff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2b9df92-850c-48ea-959e-a2e2c1afd367', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa54d6d-0def-4ada-8dbe-ea08212d524e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:21 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Volume volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 (b2b9df92-850c-48ea-959e-a2e2c1afd367): created successfully Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fa54d6d-0def-4ada-8dbe-ea08212d524e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Flow 'volume_create_manager' (50e102f4-c04f-4b6f-8345-7af94a8133fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:18:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b2fb636c-6614-473c-b1f5-a6b96d230178 tempest-VolumeTypesAccessTest-1648787131 None] Created volume successfully. Jul 07 09:18:21 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:21 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0 Jul 07 09:18:21 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:22 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f137e19-91f2-447c-8692-3946e31351d0" returned: 0 in 0.642s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-8f137e19-91f2-447c-8692-3946e31351d0" released by "delete_volume" :: held 1.539s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Created reservations ['d9a37997-cccf-452f-a429-8c4bec51efa2'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:22 devstack cinder-volume[86769]: WARNING cinder.quota [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1943681888 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1943681888, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:18:22 devstack cinder-volume[86769]: WARNING cinder.quota [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1943681888 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1943681888, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Created reservations ['6b1e31d9-cf0f-4cef-82c1-04290deb5e40', 'b50da057-49e0-412e-9d47-5ece791f4ec0', '78a5e794-8eff-4b00-b36b-ae8a38de1370', 'c8ce7111-e96b-4e1c-abaf-b61504435e42'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Acquiring lock "cinder-b2b9df92-850c-48ea-959e-a2e2c1afd367-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Lock "cinder-b2b9df92-850c-48ea-959e-a2e2c1afd367-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Acquiring lock "cinder-quobyte-b2b9df92-850c-48ea-959e-a2e2c1afd367" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Lock "cinder-quobyte-b2b9df92-850c-48ea-959e-a2e2c1afd367" acquired by "delete_volume" :: waited 0.035s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:22 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:18:22 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5398e97e-98c6-43fe-9538-e1841ac2028d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:22 devstack sudo[96040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 Jul 07 09:18:22 devstack sudo[96040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:23 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:18:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-50ebf74b-105c-47fd-a555-3596b467a161 tempest-GroupsV314Test-1614592346 None] Delete group completed successfully. Jul 07 09:18:23 devstack sudo[96040]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367" returned: 0 in 0.843s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Acquiring lock "cinder-quobyte-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:23 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367 Jul 07 09:18:23 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c34d36-28c0-43de-b147-77632ce68cc7]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:23 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:18:23 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:24 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b2b9df92-850c-48ea-959e-a2e2c1afd367" returned: 0 in 0.736s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Lock "cinder-quobyte-b2b9df92-850c-48ea-959e-a2e2c1afd367" released by "delete_volume" :: held 1.631s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:24 devstack cinder-volume[86769]: WARNING cinder.quota [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1095890100 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1095890100, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:18:24 devstack cinder-volume[86769]: WARNING cinder.quota [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1095890100 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1095890100, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Created reservations ['f85b5b74-3268-4b92-a869-e59833590e31', 'd430722e-8fba-484d-bd24-f8ef81aa64a1', '130b2da0-9449-4470-a3e1-b338e241ed29', 'ea60b301-d868-4bf5-8bf6-44f7c8a27cdb'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:24 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:18:24 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:24 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.892s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:24 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b Jul 07 09:18:24 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:25 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.998s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:18:25 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" returned: 0 in 0.931s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Deleted volume successfully. Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Lock "cinder-quobyte-13edc1f4-e0f1-4c82-bd9e-2d3d6d15380b" released by "delete_volume" :: held 1.908s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-511b4c1a-89fc-452f-8d1c-c14151b8f472 tempest-VolumeTypesAccessTest-1648787131 None] Lock "cinder-b2b9df92-850c-48ea-959e-a2e2c1afd367-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Created reservations ['3d8412c8-083e-4a07-a693-bf62a8556814'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Created reservations ['95dc64a0-1769-4d61-b3c1-5018261b5820', '8eb5b37d-2cc6-466a-8340-6eb02d6c496f', '0d84ca02-5a9d-407d-9c2e-7ebf4d8ce73d', '5fc5aa08-a5c3-4e83-ad9e-b074a5f4ed90'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:25 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:18:25 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:26 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.068s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:18:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b7a8178c-785b-47b0-8b53-5df62fc3b10c tempest-GroupsV314Test-1614592346 None] Delete group completed successfully. Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:26 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:18:26 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:27 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.788s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:18:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:18:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:18:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:18:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-cdab156c-305a-42c8-8f39-7e76223a7eb3 req-854c734a-df8e-4be7-9b31-6853e3ce645f tempest-TestMinimumBasicScenario-1261222034 None] Terminate volume connection completed successfully. Jul 07 09:18:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-cdab156c-305a-42c8-8f39-7e76223a7eb3 req-854c734a-df8e-4be7-9b31-6853e3ce645f tempest-TestMinimumBasicScenario-1261222034 None] Deleting attachment 5fc3eddc-da0a-41b5-bbd2-2fe980ba1c87. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:18:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Acquiring lock "cinder-8c350d18-9b1f-45c1-b26e-5b2649145d9d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Lock "cinder-8c350d18-9b1f-45c1-b26e-5b2649145d9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Acquiring lock "cinder-quobyte-8c350d18-9b1f-45c1-b26e-5b2649145d9d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Lock "cinder-quobyte-8c350d18-9b1f-45c1-b26e-5b2649145d9d" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f3022-51cf-4037-b01a-cd9be7d384b5]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:35 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d Jul 07 09:18:35 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:36 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d" returned: 0 in 0.961s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:36 devstack sudo[96139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d Jul 07 09:18:36 devstack sudo[96139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:37 devstack sudo[96139]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c350d18-9b1f-45c1-b26e-5b2649145d9d" returned: 0 in 0.947s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Lock "cinder-quobyte-8c350d18-9b1f-45c1-b26e-5b2649145d9d" released by "delete_volume" :: held 1.997s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Created reservations ['d5f98c2a-d1da-4252-96c4-41ca6934c744', '3a9d533d-b4bc-4202-b1a2-531eced71674', '544e1854-07eb-4308-a80a-4634633a9137', '88be06f9-3155-4cf4-90ac-7599a1b9d985'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:37 devstack sudo[96150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:18:37 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:38 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.887s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:38 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:18:38 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Deleted volume successfully. Jul 07 09:18:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-073064d6-c99c-4b10-a48b-0b9ef8bcd658 tempest-TestMinimumBasicScenario-1261222034 None] Lock "cinder-8c350d18-9b1f-45c1-b26e-5b2649145d9d-delete_volume" released by "delete_volume" :: held 3.172s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:47 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=44,cinder:SELECT=27,cinder:INSERT=7 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:18:48 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=42,cinder:SELECT=33,cinder:INSERT=12,cinder:DELETE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Flow 'volume_create_manager' (65d4f56a-7b1c-41ea-b3a7-d24c5a36999a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640aab74-7e4e-4f25-b541-7e317ab0b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640aab74-7e4e-4f25-b541-7e317ab0b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-123395762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e2506af87249e3b816fd5d18e9a066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:18:53Z,use_quota=True,user_id='5a6d3d9f3c2540ec8cf2523cde00539c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62358162-7db8-4e9d-9944-e9453e22573c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62358162-7db8-4e9d-9944-e9453e22573c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e428137c-c2eb-4c82-a1c2-ac6fded788a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e428137c-c2eb-4c82-a1c2-ac6fded788a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37', 'volume_name': 'volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf24cef-7367-40e2-82df-33bd2b15e688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf24cef-7367-40e2-82df-33bd2b15e688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb71cced-4ee3-43c5-850c-d7a6fff8f3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Volume 2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37', 'volume_size': 1} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-123395762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e2506af87249e3b816fd5d18e9a066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:18:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:18:53Z,use_quota=True,user_id='5a6d3d9f3c2540ec8cf2523cde00539c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Creating volume 2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:18:53 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:18:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:53 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 1073741824 Jul 07 09:18:53 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:54 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 1073741824" returned: 0 in 1.084s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:54 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 Jul 07 09:18:54 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:55 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37" returned: 0 in 1.302s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.498s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb71cced-4ee3-43c5-850c-d7a6fff8f3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b56a526-a7bc-422c-96a1-312ada9af241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:18:55 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Volume volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 (2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37): created successfully Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b56a526-a7bc-422c-96a1-312ada9af241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:18:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Flow 'volume_create_manager' (65d4f56a-7b1c-41ea-b3a7-d24c5a36999a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:18:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ae6f5988-572f-4530-9ad5-1851f8a8277f tempest-VolumesMetadataTest-1489492889 None] Created volume successfully. Jul 07 09:18:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Acquiring lock "cinder-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Lock "cinder-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Acquiring lock "cinder-quobyte-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:18:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Lock "cinder-quobyte-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:18:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ee3f5e-0cea-4704-b02d-534f81498df5]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:18:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:57 devstack sudo[96284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 Jul 07 09:18:57 devstack sudo[96284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:58 devstack sudo[96284]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37" returned: 0 in 0.915s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:58 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37 Jul 07 09:18:58 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:18:59 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37" returned: 0 in 0.748s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Lock "cinder-quobyte-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37" released by "delete_volume" :: held 1.716s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Created reservations ['82f2eb0b-ab69-40b7-a02d-26a8c540bc0a', '0f53444b-b279-42f4-b82c-cbcb5dbdb802', '746dd90a-76d8-4b0a-b2c2-db12b07b32fd', '93405337-3d81-46ad-9bbc-4a76f87973a2'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:18:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:18:59 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:18:59 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:00 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.799s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:00 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:19:00 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Deleted volume successfully. Jul 07 09:19:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-96d07c81-abd8-4baa-b116-a1a16672f4d2 tempest-VolumesMetadataTest-1489492889 None] Lock "cinder-2a0d3cfe-ba46-499b-a2c1-7fadeda3ab37-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Flow 'volume_create_manager' (b2afcc9f-078e-420b-970e-25f69759cf41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cce5028-bcd7-459f-9f56-1a23da972901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cce5028-bcd7-459f-9f56-1a23da972901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-314262809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4111e8-923f-4b00-a168-e2d909a0fa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6394d39e58424503af6b485278ba50f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:04Z,use_quota=True,user_id='e7aecd210f7c4e23a453286206bd3b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1cc289-549b-4513-b946-912b6424c50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf1cc289-549b-4513-b946-912b6424c50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e4582b-6ceb-428f-8a34-294507ff1c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e4582b-6ceb-428f-8a34-294507ff1c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe4111e8-923f-4b00-a168-e2d909a0fa49', 'volume_name': 'volume-fe4111e8-923f-4b00-a168-e2d909a0fa49', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b05da60-f319-4145-9b02-036526502381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b05da60-f319-4145-9b02-036526502381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f0f497-8cfd-4951-97cf-01ddd770d30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Volume fe4111e8-923f-4b00-a168-e2d909a0fa49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe4111e8-923f-4b00-a168-e2d909a0fa49', 'volume_size': 1} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-314262809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe4111e8-923f-4b00-a168-e2d909a0fa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6394d39e58424503af6b485278ba50f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:04Z,use_quota=True,user_id='e7aecd210f7c4e23a453286206bd3b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Creating volume fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:04 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:04 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 1073741824 Jul 07 09:19:04 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:05 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 1073741824" returned: 0 in 0.990s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:05 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:05 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:06 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f0f497-8cfd-4951-97cf-01ddd770d30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe4111e8-923f-4b00-a168-e2d909a0fa49', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340232d1-03e6-4837-9eb6-28e4fe319964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Volume volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 (fe4111e8-923f-4b00-a168-e2d909a0fa49): created successfully Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (340232d1-03e6-4837-9eb6-28e4fe319964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Flow 'volume_create_manager' (b2afcc9f-078e-420b-970e-25f69759cf41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-72d7b2c0-144e-4986-bb12-3d8c4e6fae22 tempest-VolumesCloneTest-917647041 None] Created volume successfully. Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Flow 'volume_create_manager' (71a167c6-8920-4276-9bfb-1a33c790c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c482cd5-96a9-4abf-b8ea-0a5eb9cb8191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Flow 'volume_create_manager' (d3faf18f-e747-46d7-8b9b-1d7e8826ee33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3751c4d-4347-465b-bc1a-0c2f095bdd9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c482cd5-96a9-4abf-b8ea-0a5eb9cb8191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2047125989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=beedb1ea-03e8-4b05-9e7f-0172eb118925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6394d39e58424503af6b485278ba50f2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=fe4111e8-923f-4b00-a168-e2d909a0fa49,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:07Z,use_quota=True,user_id='e7aecd210f7c4e23a453286206bd3b96',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c0383-fe40-47cc-9510-0123f315d2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (565c0383-fe40-47cc-9510-0123f315d2ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fef53c-d91d-48b1-ad73-c2ece56f2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3751c4d-4347-465b-bc1a-0c2f095bdd9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-483203712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990fb56f-a680-4d8f-9d30-f4df2f8a045b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31545e235854ffcb0510dca15375d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:07Z,use_quota=True,user_id='1bbb8c549ae846aa8c113e2b1a8cff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a262d526-5cce-4cb3-bf37-92b9e9f77f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a262d526-5cce-4cb3-bf37-92b9e9f77f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5c0281-9cb6-4931-ac84-176b40d8c293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce5c0281-9cb6-4931-ac84-176b40d8c293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '990fb56f-a680-4d8f-9d30-f4df2f8a045b', 'volume_name': 'volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9e3f2a-eb25-43e4-a43d-0d0ff9e409c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c9e3f2a-eb25-43e4-a43d-0d0ff9e409c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ca80c0-6b22-4f67-9c7a-64b988b9295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Volume 990fb56f-a680-4d8f-9d30-f4df2f8a045b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b', 'volume_size': 1} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-483203712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=990fb56f-a680-4d8f-9d30-f4df2f8a045b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31545e235854ffcb0510dca15375d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:07Z,use_quota=True,user_id='1bbb8c549ae846aa8c113e2b1a8cff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Creating volume 990fb56f-a680-4d8f-9d30-f4df2f8a045b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:07 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87fef53c-d91d-48b1-ad73-c2ece56f2a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'beedb1ea-03e8-4b05-9e7f-0172eb118925', 'volume_name': 'volume-beedb1ea-03e8-4b05-9e7f-0172eb118925', 'volume_size': 2, 'source_volid': 'fe4111e8-923f-4b00-a168-e2d909a0fa49', 'source_volstatus': 'available'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5791391-5efc-48b4-9ade-3061219b219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5791391-5efc-48b4-9ade-3061219b219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:07 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b 1073741824 Jul 07 09:19:07 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42f47fd-12e4-4e1e-8c15-171a9cfad734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:07 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Volume beedb1ea-03e8-4b05-9e7f-0172eb118925: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-beedb1ea-03e8-4b05-9e7f-0172eb118925', 'volume_size': 2, 'source_volid': 'fe4111e8-923f-4b00-a168-e2d909a0fa49', 'source_volstatus': 'available'} Jul 07 09:19:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:08 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b 1073741824" returned: 0 in 1.111s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:08 devstack sudo[96322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b Jul 07 09:19:08 devstack sudo[96322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:09 devstack sudo[96322]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b" returned: 0 in 0.837s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.949s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:09 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Cloning volume fe4111e8-923f-4b00-a168-e2d909a0fa49 to volume beedb1ea-03e8-4b05-9e7f-0172eb118925 Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0ca80c0-6b22-4f67-9c7a-64b988b9295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ebc646-f068-4243-87e6-a9f39e5a56ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:09 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Volume volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b (990fb56f-a680-4d8f-9d30-f4df2f8a045b): created successfully Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ebc646-f068-4243-87e6-a9f39e5a56ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Flow 'volume_create_manager' (d3faf18f-e747-46d7-8b9b-1d7e8826ee33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Creating offline snapshot 9497cbe5-f5a4-4413-9200-e4a530e65ab5 of volume fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:19:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a58d25c4-6a5e-4259-98a0-e704b7c0ead9 tempest-AttachVolumeTestJSON-1171211741 None] Created volume successfully. Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53745ed-3e49-458e-b7f4-d78e546d81da]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:10 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:10 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:11 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 1.157s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:11 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 1G Jul 07 09:19:11 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:11 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 1G" returned: 0 in 0.857s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:11 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 Jul 07 09:19:11 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:12 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5" returned: 0 in 0.889s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:12 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 is being set with open permissions: ugo+rw Jul 07 09:19:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:12 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 Jul 07 09:19:12 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:13 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5" returned: 0 in 0.835s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:13 devstack sudo[96380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info Jul 07 09:19:13 devstack sudo[96380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:14 devstack sudo[96380]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info" returned: 0 in 1.228s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:14 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info is being set with open permissions: ugo+rw Jul 07 09:19:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:14 devstack sudo[96426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info Jul 07 09:19:14 devstack sudo[96426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:15 devstack sudo[96426]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.info" returned: 0 in 0.738s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Acquiring lock "cinder-quobyte-beedb1ea-03e8-4b05-9e7f-0172eb118925" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-beedb1ea-03e8-4b05-9e7f-0172eb118925" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] snapshot: 9497cbe5-f5a4-4413-9200-e4a530e65ab5, volume: beedb1ea-03e8-4b05-9e7f-0172eb118925, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c9c0e-5dac-41ab-93a4-a0216c3e1122]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:15 devstack sudo[96448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 Jul 07 09:19:15 devstack sudo[96448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:16 devstack sudo[96448]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5" returned: 0 in 0.953s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4111e8-923f-4b00-a168-e2d909a0fa49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:19:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:19:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:19:16 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[70eb1567-b89e-4fd9-bf60-80691ffc9571]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:16 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:16 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:17 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 1.104s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:17 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:19:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:17 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 Jul 07 09:19:17 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (76a908a5-c656-48d2-9e8f-60091d0e8f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627e5df6-eb55-444e-b78b-8a710ee93a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (627e5df6-eb55-444e-b78b-8a710ee93a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1178048274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f7d40a-bf7d-46ee-a4e6-273290f11db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:20Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c41926-5755-4109-b7e3-f5bcceb10f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c41926-5755-4109-b7e3-f5bcceb10f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61b1b3e-768e-4039-9a1c-16b57934d523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61b1b3e-768e-4039-9a1c-16b57934d523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f7d40a-bf7d-46ee-a4e6-273290f11db5', 'volume_name': 'volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6668585a-72ea-48e8-be76-b04de2b4fee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6668585a-72ea-48e8-be76-b04de2b4fee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff69d8-82ff-4c83-9706-7c295f2098a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Volume 04f7d40a-bf7d-46ee-a4e6-273290f11db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5', 'volume_size': 1} Jul 07 09:19:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=15,cinder:INSERT=6,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:19:25 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925" returned: 0 in 7.715s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41bf8e6-0fa6-4ba4-8878-ace363c6af15]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:25 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:25 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:26 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 1.075s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49, size 1024.00 MB, duration 7.72 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:19:26 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Converted 1024.00 MB image at 132.70 MB/s Jul 07 09:19:26 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 is being set with open permissions: ugo+rw Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:26 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 Jul 07 09:19:26 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:27 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:19:27 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:27 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.945s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:19:27 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925" returned: 0 in 1.237s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-beedb1ea-03e8-4b05-9e7f-0172eb118925" released by "_copy_volume_from_snapshot" :: held 12.228s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Acquiring lock "cinder-quobyte-9497cbe5-f5a4-4413-9200-e4a530e65ab5" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-9497cbe5-f5a4-4413-9200-e4a530e65ab5" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Deleting offline snapshot 9497cbe5-f5a4-4413-9200-e4a530e65ab5 of volume fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:19:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] snapshot_file for this snap is: volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:19:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be3e0d6-288d-4d7d-9fd0-baed1783d59f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:28 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 Jul 07 09:19:28 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:29 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5" returned: 0 in 1.255s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe4111e8-923f-4b00-a168-e2d909a0fa49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:19:29 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[692350fb-6fc1-4fc3-b65e-ac93fa02062f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:29 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:29 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:30 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 0.893s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:30 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 Jul 07 09:19:30 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:31 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5" returned: 0 in 0.994s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:31 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5 Jul 07 09:19:31 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:31 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49.9497cbe5-f5a4-4413-9200-e4a530e65ab5" returned: 0 in 0.728s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-9497cbe5-f5a4-4413-9200-e4a530e65ab5" released by "_delete_snapshot" :: held 3.997s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.319s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 17.918s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42f47fd-12e4-4e1e-8c15-171a9cfad734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-beedb1ea-03e8-4b05-9e7f-0172eb118925', 'volume_size': 2, 'source_volid': 'fe4111e8-923f-4b00-a168-e2d909a0fa49', 'source_volstatus': 'available'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822a76f3-94f6-4f06-90d5-5b3fcc798724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d94ec6-9f06-4466-b124-e3eb3f9af66a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:32 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Volume volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 (beedb1ea-03e8-4b05-9e7f-0172eb118925): created successfully Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (822a76f3-94f6-4f06-90d5-5b3fcc798724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Flow 'volume_create_manager' (71a167c6-8920-4276-9bfb-1a33c790c217) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5aaf531d-c013-4d4e-a5b1-2f2bc890551e tempest-VolumesCloneTest-917647041 None] Created volume successfully. Jul 07 09:19:32 devstack sudo[96543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b Jul 07 09:19:32 devstack sudo[96543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Acquiring lock "cinder-beedb1ea-03e8-4b05-9e7f-0172eb118925-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Lock "cinder-beedb1ea-03e8-4b05-9e7f-0172eb118925-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:32 devstack sudo[96543]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b" returned: 0 in 0.854s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.888s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.315s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1178048274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f7d40a-bf7d-46ee-a4e6-273290f11db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:20Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Creating volume 04f7d40a-bf7d-46ee-a4e6-273290f11db5 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:32 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:33 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 1073741824 Jul 07 09:19:33 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e20ca86e-648c-4fc6-be39-1675d414c3fc', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:19:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Acquiring lock "cinder-quobyte-beedb1ea-03e8-4b05-9e7f-0172eb118925" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-beedb1ea-03e8-4b05-9e7f-0172eb118925" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b5a3c6-20e2-4ae1-b6d5-ced3cd6b5376]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-02150105-5f41-4fc7-ad02-0de634506176 req-1a855521-76b7-455f-a127-86e12e3fc3a5 tempest-AttachVolumeTestJSON-1171211741 None] attachment_update completed successfully. Jul 07 09:19:33 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 Jul 07 09:19:33 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:34 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 1073741824" returned: 0 in 1.038s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:34 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 Jul 07 09:19:34 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:34 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925" returned: 0 in 1.036s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:34 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925 Jul 07 09:19:34 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:34 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4ff69d8-82ff-4c83-9706-7c295f2098a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a04ddf-b45a-4810-9f9f-4994c46a2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:34 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Volume volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 (04f7d40a-bf7d-46ee-a4e6-273290f11db5): created successfully Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39a04ddf-b45a-4810-9f9f-4994c46a2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (76a908a5-c656-48d2-9e8f-60091d0e8f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ffa57a71-7493-4675-8e7f-880353a27230 tempest-VolumesActionsTest-1986577943 None] Created volume successfully. Jul 07 09:19:35 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-beedb1ea-03e8-4b05-9e7f-0172eb118925" returned: 0 in 0.838s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-beedb1ea-03e8-4b05-9e7f-0172eb118925" released by "delete_volume" :: held 1.931s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Created reservations ['7ebfd261-fd8e-4505-b1ef-f1d81bdb2a15', '50282fc8-6dcc-4f6e-af39-743f2e684601', '1b1968d9-6846-4d93-8134-1f062507eee4', 'a82425e7-4599-4a42-8ea8-7bedae1c5024'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:35 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:19:35 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-05712307-acaf-4351-b8ba-9920b2bef962 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5" by "attach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-05712307-acaf-4351-b8ba-9920b2bef962 tempest-VolumesActionsTest-1986577943 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5" acquired by "attach_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-05712307-acaf-4351-b8ba-9920b2bef962 tempest-VolumesActionsTest-1986577943 None] Attaching volume 04f7d40a-bf7d-46ee-a4e6-273290f11db5 to instance 033fe794-2a9d-4da1-8e71-6ed6b1438b69 at mountpoint /dev/vdb on host None. Jul 07 09:19:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-05712307-acaf-4351-b8ba-9920b2bef962 tempest-VolumesActionsTest-1986577943 None] Attach volume completed successfully. Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-05712307-acaf-4351-b8ba-9920b2bef962 tempest-VolumesActionsTest-1986577943 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5" released by "attach_volume" :: held 0.105s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:35 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.753s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:19:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Deleted volume successfully. Jul 07 09:19:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f8c0c50-b1b4-4805-9bdf-d77d6fd30309 tempest-VolumesCloneTest-917647041 None] Lock "cinder-beedb1ea-03e8-4b05-9e7f-0172eb118925-delete_volume" released by "delete_volume" :: held 3.051s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Acquiring lock "cinder-fe4111e8-923f-4b00-a168-e2d909a0fa49-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Lock "cinder-fe4111e8-923f-4b00-a168-e2d909a0fa49-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Acquiring lock "cinder-quobyte-fe4111e8-923f-4b00-a168-e2d909a0fa49" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-fe4111e8-923f-4b00-a168-e2d909a0fa49" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:36 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca7e0c8-c3b7-4577-bf45-b62d4a9162e4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ecb9efe6-e76c-4e7f-bd57-17e242314ef3 tempest-VolumesActionsTest-747667661 None] Terminate volume connection completed successfully. Jul 07 09:19:36 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:36 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ecb9efe6-e76c-4e7f-bd57-17e242314ef3 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-detach_volume" by "detach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ecb9efe6-e76c-4e7f-bd57-17e242314ef3 tempest-VolumesActionsTest-747667661 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ecb9efe6-e76c-4e7f-bd57-17e242314ef3 tempest-VolumesActionsTest-747667661 None] Detaching volume 04f7d40a-bf7d-46ee-a4e6-273290f11db5 from instance 033fe794-2a9d-4da1-8e71-6ed6b1438b69. Jul 07 09:19:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ecb9efe6-e76c-4e7f-bd57-17e242314ef3 tempest-VolumesActionsTest-747667661 None] Detach volume completed successfully. Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ecb9efe6-e76c-4e7f-bd57-17e242314ef3 tempest-VolumesActionsTest-747667661 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:37 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 0.917s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:37 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49 Jul 07 09:19:37 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8816cb16-31cf-4fe2-9f73-d42b6d9dfd80 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-detach_volume" by "detach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8816cb16-31cf-4fe2-9f73-d42b6d9dfd80 tempest-VolumesActionsTest-1986577943 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8816cb16-31cf-4fe2-9f73-d42b6d9dfd80 tempest-VolumesActionsTest-1986577943 None] Volume detach called, but volume not attached. Jul 07 09:19:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8816cb16-31cf-4fe2-9f73-d42b6d9dfd80 tempest-VolumesActionsTest-1986577943 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-detach_volume" released by "detach_volume" :: held 0.023s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:38 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fe4111e8-923f-4b00-a168-e2d909a0fa49" returned: 0 in 0.725s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Lock "cinder-quobyte-fe4111e8-923f-4b00-a168-e2d909a0fa49" released by "delete_volume" :: held 1.731s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Created reservations ['0f20a131-adb6-4597-8619-9baede7fc813', '838b88bb-32d7-4fcc-9e88-cde1f5d727f4', '844b83eb-a753-4084-b291-0f2eeff1c336', '19e9e0a0-0ddf-4da3-8aca-8485ae994922'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:38 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:19:38 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "cinder-quobyte-04f7d40a-bf7d-46ee-a4e6-273290f11db5" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-quobyte-04f7d40a-bf7d-46ee-a4e6-273290f11db5" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b18fdb-786c-4f46-a198-d7c5bfcd0ff2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:38 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 Jul 07 09:19:38 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Flow 'volume_create_manager' (b298f192-c0c4-4677-ae27-50344817537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbda013-e299-46d5-bf6b-8e315149219e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdbda013-e299-46d5-bf6b-8e315149219e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-839117931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5969ee18-4bae-4296-8c74-b47f097c1d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31545e235854ffcb0510dca15375d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:39Z,use_quota=True,user_id='1bbb8c549ae846aa8c113e2b1a8cff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cfd4a2-224e-4e72-b71c-ccefb0cf16b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00cfd4a2-224e-4e72-b71c-ccefb0cf16b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cfaa22-0104-4826-ac76-85ac9b8617a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8cfaa22-0104-4826-ac76-85ac9b8617a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5969ee18-4bae-4296-8c74-b47f097c1d81', 'volume_name': 'volume-5969ee18-4bae-4296-8c74-b47f097c1d81', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1565478-ca8c-4801-a3cb-33387dc4d8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1565478-ca8c-4801-a3cb-33387dc4d8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2324e7-d998-49e6-9ba8-6a3ff34b6772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:38 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Volume 5969ee18-4bae-4296-8c74-b47f097c1d81: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5969ee18-4bae-4296-8c74-b47f097c1d81', 'volume_size': 1} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-839117931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5969ee18-4bae-4296-8c74-b47f097c1d81,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31545e235854ffcb0510dca15375d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:39Z,use_quota=True,user_id='1bbb8c549ae846aa8c113e2b1a8cff03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Creating volume 5969ee18-4bae-4296-8c74-b47f097c1d81 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:39 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:39 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 1073741824 Jul 07 09:19:39 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:39 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.858s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:19:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Deleted volume successfully. Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b828cead-b0ab-4eed-9157-e2379042dfef tempest-VolumesCloneTest-917647041 None] Lock "cinder-fe4111e8-923f-4b00-a168-e2d909a0fa49-delete_volume" released by "delete_volume" :: held 2.833s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:39 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5" returned: 0 in 0.921s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:39 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5 Jul 07 09:19:39 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:40 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 1073741824" returned: 0 in 1.215s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:40 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 Jul 07 09:19:40 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:40 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-04f7d40a-bf7d-46ee-a4e6-273290f11db5" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-quobyte-04f7d40a-bf7d-46ee-a4e6-273290f11db5" released by "delete_volume" :: held 1.786s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Created reservations ['d6eaa212-fc3f-440a-bb86-9c6307e77d34', '07f32c3a-95b7-4766-a448-f424e390c0ee', 'b58b5d59-3b68-469c-96dd-733a04bb431d', '14debf2b-bed5-4c17-8e68-acce158dc009'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:40 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:19:40 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:41 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81" returned: 0 in 1.289s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] <== create_volume: return (2577ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.581s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef2324e7-d998-49e6-9ba8-6a3ff34b6772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5969ee18-4bae-4296-8c74-b47f097c1d81', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3f2085-eab8-468f-b259-1795e52d3743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Volume volume-5969ee18-4bae-4296-8c74-b47f097c1d81 (5969ee18-4bae-4296-8c74-b47f097c1d81): created successfully Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b3f2085-eab8-468f-b259-1795e52d3743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Flow 'volume_create_manager' (b298f192-c0c4-4677-ae27-50344817537c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-56c266f9-1a47-446a-828c-04a7d9ab3720 tempest-AttachVolumeTestJSON-1171211741 None] Created volume successfully. Jul 07 09:19:41 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.193s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:19:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Deleted volume successfully. Jul 07 09:19:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-556556b9-8a49-4939-ab66-8f31855db81e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-04f7d40a-bf7d-46ee-a4e6-273290f11db5-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec79b41-20ad-417c-8bef-e31ac93f8e4c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:45 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 Jul 07 09:19:45 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Flow 'volume_create_manager' (1cdf35da-f9a5-4669-85db-b4dd17182843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eedad5cf-ec5f-4c43-be96-f6b6285af10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eedad5cf-ec5f-4c43-be96-f6b6285af10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1653627991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e15054-bcc2-4596-b447-52d87d52a392,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='deaff3c2705f45159a40a6799da405cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:46Z,use_quota=True,user_id='7825edab08a045949ff6714935e74b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4aa246-b242-455c-9ce4-567ad06d757e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4aa246-b242-455c-9ce4-567ad06d757e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3006d7c-e9c1-48ab-b605-161de01f5a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3006d7c-e9c1-48ab-b605-161de01f5a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e15054-bcc2-4596-b447-52d87d52a392', 'volume_name': 'volume-66e15054-bcc2-4596-b447-52d87d52a392', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd444fd8-889e-4e0e-98b0-6c8480f1e68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd444fd8-889e-4e0e-98b0-6c8480f1e68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa47ec52-5a61-4efa-9df3-a2c2261f3349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Volume 66e15054-bcc2-4596-b447-52d87d52a392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e15054-bcc2-4596-b447-52d87d52a392', 'volume_size': 1} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:46 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.881s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1653627991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e15054-bcc2-4596-b447-52d87d52a392,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='deaff3c2705f45159a40a6799da405cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:46Z,use_quota=True,user_id='7825edab08a045949ff6714935e74b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Creating volume 66e15054-bcc2-4596-b447-52d87d52a392 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:46 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:46 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 1073741824 Jul 07 09:19:46 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-5969ee18-4bae-4296-8c74-b47f097c1d81', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '802a754f-9994-42ef-b9a8-7528ac05594c', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:19:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-4e46fb31-1386-4e58-b0a3-4e12e99acfa1 req-c52c2d10-e9be-407b-a199-5848c5909b33 tempest-AttachVolumeTestJSON-1171211741 None] attachment_update completed successfully. Jul 07 09:19:47 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 1073741824" returned: 0 in 1.333s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:47 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=55,cinder:SELECT=55,cinder:DELETE=6,cinder:INSERT=14 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:19:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:47 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 Jul 07 09:19:47 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:48 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa47ec52-5a61-4efa-9df3-a2c2261f3349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e15054-bcc2-4596-b447-52d87d52a392', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062cab34-009d-4013-9dd8-6579dd65a8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:48 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Volume volume-66e15054-bcc2-4596-b447-52d87d52a392 (66e15054-bcc2-4596-b447-52d87d52a392): created successfully Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062cab34-009d-4013-9dd8-6579dd65a8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Flow 'volume_create_manager' (1cdf35da-f9a5-4669-85db-b4dd17182843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2fb5dde3-e0c7-4b08-9c31-1a092221ff21 tempest-VolumesListTestJSON-251030342 None] Created volume successfully. Jul 07 09:19:49 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Flow 'volume_create_manager' (7dd2938d-1c75-42f0-8ec0-c2124df260c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe070cf-d0f2-448d-b2fc-fc60fbd15d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe070cf-d0f2-448d-b2fc-fc60fbd15d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-289610447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a711d5f7-6195-4daf-acfd-c9816a1ad0b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='deaff3c2705f45159a40a6799da405cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:50Z,use_quota=True,user_id='7825edab08a045949ff6714935e74b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a98b66-58a8-4f67-8ac5-02965183b9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a98b66-58a8-4f67-8ac5-02965183b9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615c74d8-b018-4124-900c-4ae92c5c92e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (615c74d8-b018-4124-900c-4ae92c5c92e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a711d5f7-6195-4daf-acfd-c9816a1ad0b8', 'volume_name': 'volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d11b11-6ab6-4d1f-a9dd-c2ac5cf812e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4d11b11-6ab6-4d1f-a9dd-c2ac5cf812e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1058e53-ecd5-4e3c-8ff6-0a83fdcbd935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Volume a711d5f7-6195-4daf-acfd-c9816a1ad0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8', 'volume_size': 1} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-289610447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a711d5f7-6195-4daf-acfd-c9816a1ad0b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='deaff3c2705f45159a40a6799da405cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:50Z,use_quota=True,user_id='7825edab08a045949ff6714935e74b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Creating volume a711d5f7-6195-4daf-acfd-c9816a1ad0b8 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:50 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:50 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 1073741824 Jul 07 09:19:50 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (d4be11bf-e784-428e-a945-ece157a1b3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b453d6c-de1d-417c-9feb-af95b83ed595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b453d6c-de1d-417c-9feb-af95b83ed595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-118506819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0f4436-e81f-401c-b3bc-d257411a94d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:50Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5676990f-0452-423e-a81c-6ff0598e5cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5676990f-0452-423e-a81c-6ff0598e5cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9563c97f-ba7a-4a4e-9b2e-0a640bf8866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9563c97f-ba7a-4a4e-9b2e-0a640bf8866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0f4436-e81f-401c-b3bc-d257411a94d3', 'volume_name': 'volume-3d0f4436-e81f-401c-b3bc-d257411a94d3', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf35f786-fa11-472e-85e5-6e532a5297a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf35f786-fa11-472e-85e5-6e532a5297a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95af2500-501e-4ae7-aa3e-23fd56f91c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Volume 3d0f4436-e81f-401c-b3bc-d257411a94d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0f4436-e81f-401c-b3bc-d257411a94d3', 'volume_size': 1} Jul 07 09:19:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:51 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 1073741824" returned: 0 in 1.077s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:51 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 Jul 07 09:19:51 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:52 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8" returned: 0 in 0.874s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.879s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-118506819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0f4436-e81f-401c-b3bc-d257411a94d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:50Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Creating volume 3d0f4436-e81f-401c-b3bc-d257411a94d3 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:52 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1058e53-ecd5-4e3c-8ff6-0a83fdcbd935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:52 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 1073741824 Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f994ff-3e0c-467b-be66-ae81b6a89e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:52 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:52 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Volume volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 (a711d5f7-6195-4daf-acfd-c9816a1ad0b8): created successfully Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3f994ff-3e0c-467b-be66-ae81b6a89e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Flow 'volume_create_manager' (7dd2938d-1c75-42f0-8ec0-c2124df260c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:52 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-449f5759-0cac-4164-9c08-886eaabd2ef7 tempest-VolumesListTestJSON-251030342 None] Created volume successfully. Jul 07 09:19:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-fe143f17-bc3d-437e-8a47-f67a1d606ca9 req-af8ef9a6-9e7d-4462-8eea-07daa9e957a9 tempest-AttachVolumeTestJSON-1171211741 None] Terminate volume connection completed successfully. Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-fe143f17-bc3d-437e-8a47-f67a1d606ca9 req-af8ef9a6-9e7d-4462-8eea-07daa9e957a9 tempest-AttachVolumeTestJSON-1171211741 None] Deleting attachment e20ca86e-648c-4fc6-be39-1675d414c3fc. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:19:53 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 1073741824" returned: 0 in 1.037s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:53 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 Jul 07 09:19:53 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Flow 'volume_create_manager' (ae0f5682-e511-4060-a5f8-7821e625008b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1eadb3-8e22-4f91-ad42-d967c4ca5ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc1eadb3-8e22-4f91-ad42-d967c4ca5ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1328109932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161b55d3-243d-4889-a536-37dc52b5e366,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='deaff3c2705f45159a40a6799da405cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:54Z,use_quota=True,user_id='7825edab08a045949ff6714935e74b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d897c8-78b1-4287-b13f-abcff0aa3e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38d897c8-78b1-4287-b13f-abcff0aa3e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117a35c7-cf00-4199-a7d8-ec495bf8e3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (117a35c7-cf00-4199-a7d8-ec495bf8e3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161b55d3-243d-4889-a536-37dc52b5e366', 'volume_name': 'volume-161b55d3-243d-4889-a536-37dc52b5e366', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249b146-bd2c-42b0-b850-cf7e2cfff28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6249b146-bd2c-42b0-b850-cf7e2cfff28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ef9b96-c29e-41e6-bbfc-87d8d7fd9932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Volume 161b55d3-243d-4889-a536-37dc52b5e366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161b55d3-243d-4889-a536-37dc52b5e366', 'volume_size': 1} Jul 07 09:19:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:54 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3" returned: 0 in 0.872s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1328109932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161b55d3-243d-4889-a536-37dc52b5e366,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='deaff3c2705f45159a40a6799da405cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:54Z,use_quota=True,user_id='7825edab08a045949ff6714935e74b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Creating volume 161b55d3-243d-4889-a536-37dc52b5e366 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:54 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:54 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 1073741824 Jul 07 09:19:54 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95af2500-501e-4ae7-aa3e-23fd56f91c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0f4436-e81f-401c-b3bc-d257411a94d3', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c4aebf-17c4-43d7-bcf0-7c750a1a4635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Volume volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 (3d0f4436-e81f-401c-b3bc-d257411a94d3): created successfully Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0c4aebf-17c4-43d7-bcf0-7c750a1a4635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (d4be11bf-e784-428e-a945-ece157a1b3c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-91338e47-e14d-4a84-84cf-f78f60430daf tempest-VolumesActionsTest-1986577943 None] Created volume successfully. Jul 07 09:19:55 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 1073741824" returned: 0 in 0.953s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:55 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 Jul 07 09:19:55 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-3d0f4436-e81f-401c-b3bc-d257411a94d3-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Lock "cinder-3d0f4436-e81f-401c-b3bc-d257411a94d3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-quobyte-3d0f4436-e81f-401c-b3bc-d257411a94d3" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-3d0f4436-e81f-401c-b3bc-d257411a94d3" acquired by "delete_volume" :: waited 0.054s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677e814-1694-475e-85fe-d189d78ebd17]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-19502cbe-b788-4d49-9b5e-860b908f3541 req-cd1cba88-5797-4e6d-982f-2758bee6b5cd tempest-AttachVolumeTestJSON-1171211741 None] Terminate volume connection completed successfully. Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-19502cbe-b788-4d49-9b5e-860b908f3541 req-cd1cba88-5797-4e6d-982f-2758bee6b5cd tempest-AttachVolumeTestJSON-1171211741 None] Deleting attachment 802a754f-9994-42ef-b9a8-7528ac05594c. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:19:55 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366" returned: 0 in 0.839s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.844s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:55 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 Jul 07 09:19:55 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ef9b96-c29e-41e6-bbfc-87d8d7fd9932) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161b55d3-243d-4889-a536-37dc52b5e366', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7520aa-262f-4baf-9630-dc24b7ff86f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:55 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Volume volume-161b55d3-243d-4889-a536-37dc52b5e366 (161b55d3-243d-4889-a536-37dc52b5e366): created successfully Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e7520aa-262f-4baf-9630-dc24b7ff86f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Flow 'volume_create_manager' (ae0f5682-e511-4060-a5f8-7821e625008b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-09a75ebb-c663-478f-9f89-fbe7f025e4ee tempest-VolumesListTestJSON-251030342 None] Created volume successfully. Jul 07 09:19:56 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3" returned: 0 in 0.855s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:56 devstack sudo[97232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3 Jul 07 09:19:56 devstack sudo[97232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:57 devstack sudo[97232]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3d0f4436-e81f-401c-b3bc-d257411a94d3" returned: 0 in 0.719s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-3d0f4436-e81f-401c-b3bc-d257411a94d3" released by "delete_volume" :: held 1.670s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Created reservations ['3bc15d88-c1f7-4b44-8f27-22c42b3e8090', '05386818-ef41-4d1c-8a9a-9a9f403ba877', '61277829-d59e-4ed4-8a18-146fa409f311', '1081229b-30fb-43b5-8302-362c26374277'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:57 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:19:57 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:58 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.932s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:19:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Deleted volume successfully. Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e13b09e-941e-47d7-8704-d5cc475de1e7 tempest-VolumesActionsTest-747667661 None] Lock "cinder-3d0f4436-e81f-401c-b3bc-d257411a94d3-delete_volume" released by "delete_volume" :: held 2.948s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (da5ab3f6-32bf-4b5d-b7bf-cbf92c2563d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bbc343-3b15-4440-ae33-854fe91a9cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8bbc343-3b15-4440-ae33-854fe91a9cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1969348393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b035df-5da0-4091-989a-a40d3502475a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:59Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa983be-ce03-4abc-9e46-c937ab57bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2aa983be-ce03-4abc-9e46-c937ab57bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43345f2-224b-41a7-ab8d-0fcfdeab15b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f43345f2-224b-41a7-ab8d-0fcfdeab15b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76b035df-5da0-4091-989a-a40d3502475a', 'volume_name': 'volume-76b035df-5da0-4091-989a-a40d3502475a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01eaf991-1f2e-48ee-9037-f833c34ad0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01eaf991-1f2e-48ee-9037-f833c34ad0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff048970-c4bb-42f5-8d18-a6388f216758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:19:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Volume 76b035df-5da0-4091-989a-a40d3502475a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76b035df-5da0-4091-989a-a40d3502475a', 'volume_size': 1} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1969348393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b035df-5da0-4091-989a-a40d3502475a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:19:59Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Creating volume 76b035df-5da0-4091-989a-a40d3502475a {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:19:58 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:19:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:58 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a 1073741824 Jul 07 09:19:58 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "cinder-161b55d3-243d-4889-a536-37dc52b5e366-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-161b55d3-243d-4889-a536-37dc52b5e366-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "cinder-quobyte-161b55d3-243d-4889-a536-37dc52b5e366" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-quobyte-161b55d3-243d-4889-a536-37dc52b5e366" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5865bc8c-0938-4b67-9056-f6295c117060]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:19:59 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a 1073741824" returned: 0 in 1.052s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:19:59 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 Jul 07 09:19:59 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:19:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:00 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a Jul 07 09:20:00 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:00 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a" returned: 0 in 0.889s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] <== create_volume: return (2000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff048970-c4bb-42f5-8d18-a6388f216758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b035df-5da0-4091-989a-a40d3502475a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3a8e1e-e0e8-419d-8234-3523e2e2441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:00 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Volume volume-76b035df-5da0-4091-989a-a40d3502475a (76b035df-5da0-4091-989a-a40d3502475a): created successfully Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c3a8e1e-e0e8-419d-8234-3523e2e2441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (da5ab3f6-32bf-4b5d-b7bf-cbf92c2563d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f2ce1d56-5a84-49d6-a8e5-3986a173dc55 tempest-VolumesActionsTest-1986577943 None] Created volume successfully. Jul 07 09:20:01 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366" returned: 0 in 1.340s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:01 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366 Jul 07 09:20:01 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:02 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-161b55d3-243d-4889-a536-37dc52b5e366" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-quobyte-161b55d3-243d-4889-a536-37dc52b5e366" released by "delete_volume" :: held 2.257s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-76b035df-5da0-4091-989a-a40d3502475a-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Created reservations ['9f0bc332-0765-428c-a456-51144e7f9d49', '165bf7f2-84d3-4f7e-b3a7-cec5c55ba9f5', 'ab954227-dad2-4eee-83b1-964b32d36d91', '080712f0-0e40-4415-8cd8-e798422d9260'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Lock "cinder-76b035df-5da0-4091-989a-a40d3502475a-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-quobyte-76b035df-5da0-4091-989a-a40d3502475a" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-76b035df-5da0-4091-989a-a40d3502475a" acquired by "delete_volume" :: waited 0.046s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:02 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:02 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ee6945-f8a9-43d9-844c-5c8c4e4e92f3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:02 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a Jul 07 09:20:02 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:02 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.654s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:02 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Deleted volume successfully. Jul 07 09:20:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2dc20e97-fe00-4e18-a41b-f59c8d5cfeb4 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-161b55d3-243d-4889-a536-37dc52b5e366-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "cinder-a711d5f7-6195-4daf-acfd-c9816a1ad0b8-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-a711d5f7-6195-4daf-acfd-c9816a1ad0b8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:03 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a" returned: 0 in 0.816s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:03 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a Jul 07 09:20:03 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "cinder-quobyte-a711d5f7-6195-4daf-acfd-c9816a1ad0b8" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-quobyte-a711d5f7-6195-4daf-acfd-c9816a1ad0b8" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e9d888-bfcd-4281-a949-04c91505e4f0]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:03 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 Jul 07 09:20:03 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:03 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-76b035df-5da0-4091-989a-a40d3502475a" returned: 0 in 0.674s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-76b035df-5da0-4091-989a-a40d3502475a" released by "delete_volume" :: held 1.543s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:03 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Created reservations ['501d8812-68ea-4d9d-9bd1-61db48ae6f77', '66ffd99d-f26d-4758-8d29-d6b8c7e7528f', '1b572ddd-c42c-43aa-8120-4005071fdc7b', '7c838b30-43f0-4304-a531-bfa078444a49'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:04 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8" returned: 0 in 0.784s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:04 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:04 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:04 devstack sudo[97323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8 Jul 07 09:20:04 devstack sudo[97323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:04 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.676s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Deleted volume successfully. Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0bc01778-00f2-4e67-bf00-f15977fec041 tempest-VolumesActionsTest-747667661 None] Lock "cinder-76b035df-5da0-4091-989a-a40d3502475a-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:04 devstack sudo[97323]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a711d5f7-6195-4daf-acfd-c9816a1ad0b8" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-quobyte-a711d5f7-6195-4daf-acfd-c9816a1ad0b8" released by "delete_volume" :: held 1.554s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Created reservations ['6b5b2560-72d6-4959-8dfb-81e10700d571', '1e9be11f-59b3-4d30-8d63-e6996611ce37', 'b21298e6-9959-46c4-bb89-91b1d0c47c15', '6363ec8b-c6b3-4949-a0f5-077ace63f0d9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:04 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:04 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (9e21fceb-c2fc-4d1d-96ec-5db5d7033b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6810aac2-86b0-430d-ba33-aa9ceba9fb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6810aac2-86b0-430d-ba33-aa9ceba9fb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182821964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c447208e-0859-4a00-b994-f4d4eea847f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:05Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d23a8a-0f85-4237-9fe1-b2da82f43496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d23a8a-0f85-4237-9fe1-b2da82f43496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38a8c07-160e-4554-b1b9-3fc092eb9b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38a8c07-160e-4554-b1b9-3fc092eb9b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c447208e-0859-4a00-b994-f4d4eea847f2', 'volume_name': 'volume-c447208e-0859-4a00-b994-f4d4eea847f2', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe6bc94-66f4-4163-b25b-a60b30d8bbcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbe6bc94-66f4-4163-b25b-a60b30d8bbcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfeb22c-d062-4ddd-b75b-93aa46ac7448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Volume c447208e-0859-4a00-b994-f4d4eea847f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c447208e-0859-4a00-b994-f4d4eea847f2', 'volume_size': 1} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1182821964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c447208e-0859-4a00-b994-f4d4eea847f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:05Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Creating volume c447208e-0859-4a00-b994-f4d4eea847f2 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:05 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:05 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 1073741824 Jul 07 09:20:05 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "cinder-66e15054-bcc2-4596-b447-52d87d52a392-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-66e15054-bcc2-4596-b447-52d87d52a392-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "cinder-quobyte-66e15054-bcc2-4596-b447-52d87d52a392" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-quobyte-66e15054-bcc2-4596-b447-52d87d52a392" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e4280-f436-41ec-97f8-54b58907e269]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:05 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 Jul 07 09:20:05 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:05 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:05 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Deleted volume successfully. Jul 07 09:20:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e92f9133-29a1-4023-8b8a-5f45e78e2d26 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-a711d5f7-6195-4daf-acfd-c9816a1ad0b8-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:06 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 1073741824" returned: 0 in 0.929s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:06 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 Jul 07 09:20:06 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:06 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:06 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392 Jul 07 09:20:06 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:06 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2" returned: 0 in 0.677s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cfeb22c-d062-4ddd-b75b-93aa46ac7448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c447208e-0859-4a00-b994-f4d4eea847f2', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1698a429-883a-40c4-a352-29e082bc1547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Volume volume-c447208e-0859-4a00-b994-f4d4eea847f2 (c447208e-0859-4a00-b994-f4d4eea847f2): created successfully Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1698a429-883a-40c4-a352-29e082bc1547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (9e21fceb-c2fc-4d1d-96ec-5db5d7033b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c11bab2b-5cd0-43b8-8bb2-cbe08d123b1e tempest-VolumesActionsTest-1986577943 None] Created volume successfully. Jul 07 09:20:07 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-66e15054-bcc2-4596-b447-52d87d52a392" returned: 0 in 0.708s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-quobyte-66e15054-bcc2-4596-b447-52d87d52a392" released by "delete_volume" :: held 1.583s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Created reservations ['68c7fb38-e385-4519-b9fb-061daac436e4', '2c06d382-28f6-4b99-93b6-a1b4e4f357a6', '71de3cae-0200-4fec-b35c-16cff5633b6d', 'f1f63934-7f7c-450d-8390-e25fc0dbca81'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:07 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:07 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-c447208e-0859-4a00-b994-f4d4eea847f2-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Lock "cinder-c447208e-0859-4a00-b994-f4d4eea847f2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-quobyte-c447208e-0859-4a00-b994-f4d4eea847f2" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-c447208e-0859-4a00-b994-f4d4eea847f2" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54cfb16-533a-492b-9e23-4b393a60daaa]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:07 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 Jul 07 09:20:07 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "cinder-5969ee18-4bae-4296-8c74-b47f097c1d81-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-5969ee18-4bae-4296-8c74-b47f097c1d81-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "cinder-quobyte-5969ee18-4bae-4296-8c74-b47f097c1d81" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-quobyte-5969ee18-4bae-4296-8c74-b47f097c1d81" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[be75bfde-8ebb-49fe-9464-1a9f9e35c1b4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:08 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.992s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:08 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Deleted volume successfully. Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb2cd7a1-fb1e-4c12-8566-8138fe41eaa6 tempest-VolumesListTestJSON-251030342 None] Lock "cinder-66e15054-bcc2-4596-b447-52d87d52a392-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:08 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 Jul 07 09:20:08 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:08 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2" returned: 0 in 1.398s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:08 devstack sudo[97364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2 Jul 07 09:20:08 devstack sudo[97364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:09 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81" returned: 0 in 0.941s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:09 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81 Jul 07 09:20:09 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:09 devstack sudo[97364]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c447208e-0859-4a00-b994-f4d4eea847f2" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-c447208e-0859-4a00-b994-f4d4eea847f2" released by "delete_volume" :: held 2.249s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Created reservations ['ef40c6eb-2833-4ba8-83fb-896e19b89fd2', '55249d6e-6e98-4baf-ab05-6fffaa4f1c9f', '07538f5b-e307-481f-9eb1-11a390d4108b', '5e6dd84a-6576-417e-8636-e6e98617b168'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:09 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5969ee18-4bae-4296-8c74-b47f097c1d81" returned: 0 in 0.886s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-quobyte-5969ee18-4bae-4296-8c74-b47f097c1d81" released by "delete_volume" :: held 1.899s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:09 devstack sudo[97370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:09 devstack sudo[97370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Created reservations ['d496000f-d8aa-4e6e-8f56-c0a3f5cdf450', '397e66ca-f3a1-43e1-9ce3-feb58ee35f76', '91f027ab-d6e4-496c-9ebb-2586af9e2567', '5561b8c0-fce5-44c4-aa27-5702540d2a62'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:10 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:10 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "cinder-990fb56f-a680-4d8f-9d30-f4df2f8a045b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-990fb56f-a680-4d8f-9d30-f4df2f8a045b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "cinder-quobyte-990fb56f-a680-4d8f-9d30-f4df2f8a045b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-quobyte-990fb56f-a680-4d8f-9d30-f4df2f8a045b" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398c5dd-a1d7-427a-b6ad-c9b18f049655]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:10 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b Jul 07 09:20:10 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:10 devstack sudo[97370]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.008s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Deleted volume successfully. Jul 07 09:20:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b45703e2-83b7-42d9-8691-a54bbca1356c tempest-VolumesActionsTest-747667661 None] Lock "cinder-c447208e-0859-4a00-b994-f4d4eea847f2-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:11 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.921s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Deleted volume successfully. Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-20240d5f-38ea-41e4-ac3f-c5ed6350bd1d tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-5969ee18-4bae-4296-8c74-b47f097c1d81-delete_volume" released by "delete_volume" :: held 3.134s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:11 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b" returned: 0 in 0.868s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:11 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b Jul 07 09:20:11 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (420f9f0d-bdb4-4744-a763-42295722c70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f194416e-f3b9-459f-8c2f-7b74a432e4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f194416e-f3b9-459f-8c2f-7b74a432e4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302257261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5f45a6-c991-4e2c-9368-2aeff29f110d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:11Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a7d63a-ed01-41e7-8af8-9939da799fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71a7d63a-ed01-41e7-8af8-9939da799fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1055bc-c522-499e-88bc-dca8bd73918d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a1055bc-c522-499e-88bc-dca8bd73918d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5f45a6-c991-4e2c-9368-2aeff29f110d', 'volume_name': 'volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc18ad9-a223-47e5-b833-3b413fb2f411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc18ad9-a223-47e5-b833-3b413fb2f411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667f98a2-d73c-4f9e-a2ad-7dd4604ad5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Volume 8c5f45a6-c991-4e2c-9368-2aeff29f110d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d', 'volume_size': 1} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1302257261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5f45a6-c991-4e2c-9368-2aeff29f110d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:11Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Creating volume 8c5f45a6-c991-4e2c-9368-2aeff29f110d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:11 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d 1073741824 Jul 07 09:20:11 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Flow 'volume_create_manager' (74bd53d5-1db2-4e8a-a3c8-f3db38dce892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec14f3a-21ed-477e-916b-3af885e6f282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ec14f3a-21ed-477e-916b-3af885e6f282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1659085592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c3e1c8-8c83-4d8e-8ce9-cea39c633002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9893f50a291a456a8945a8434c3a2b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:12Z,use_quota=True,user_id='32c45e90715744b7b52c754c9e40039c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da349b24-3365-484b-a7e0-35ff8a5bfaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da349b24-3365-484b-a7e0-35ff8a5bfaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3524e2ae-996f-45c0-8200-2669adc55eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3524e2ae-996f-45c0-8200-2669adc55eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c3e1c8-8c83-4d8e-8ce9-cea39c633002', 'volume_name': 'volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0aa1e4-6e87-4933-854c-5a201852d15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0aa1e4-6e87-4933-854c-5a201852d15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61ddd91-1f42-4d3b-9b4c-716ea6c94fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Volume 19c3e1c8-8c83-4d8e-8ce9-cea39c633002: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002', 'volume_size': 1} Jul 07 09:20:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:12 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-990fb56f-a680-4d8f-9d30-f4df2f8a045b" returned: 0 in 0.761s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-quobyte-990fb56f-a680-4d8f-9d30-f4df2f8a045b" released by "delete_volume" :: held 1.689s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Created reservations ['d757dcd4-6729-4b9a-bede-cd0b0cc4b61f', '7da39962-75f9-44d4-b4c2-66ca6c6eec47', 'cd2710a0-18a9-4f69-a389-2e916f1883f4', 'ad46f318-0714-4f1a-8f33-d74e3da37812'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:12 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:12 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:12 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d 1073741824" returned: 0 in 1.004s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:12 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d Jul 07 09:20:12 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "cinder-64b647ac-89a5-4184-a17d-47773449710b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-64b647ac-89a5-4184-a17d-47773449710b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "cinder-quobyte-64b647ac-89a5-4184-a17d-47773449710b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-quobyte-64b647ac-89a5-4184-a17d-47773449710b" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:13 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[99207123-465b-4e6a-b3f7-1cf1e5a88ed9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.827s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Deleted volume successfully. Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2d45707c-dcc6-4886-ab9e-58684ab15eec tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-990fb56f-a680-4d8f-9d30-f4df2f8a045b-delete_volume" released by "delete_volume" :: held 2.772s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:13 devstack sudo[97398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b Jul 07 09:20:13 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Flow 'volume_create_manager' (617d2fe6-39be-4914-94c3-aff694316d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657faf14-4958-4256-b765-c45a78e2a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657faf14-4958-4256-b765-c45a78e2a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2068037121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afef07de-19af-4284-9952-ab7d7bda2621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e8a9f8a08a46ad901ded278d045500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:13Z,use_quota=True,user_id='c39d896b053a435e81028784aff61e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6de7db-9b4f-4e8e-a0fc-697a3a980b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6de7db-9b4f-4e8e-a0fc-697a3a980b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59270cab-842a-4f14-96ae-78e1d335e7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59270cab-842a-4f14-96ae-78e1d335e7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afef07de-19af-4284-9952-ab7d7bda2621', 'volume_name': 'volume-afef07de-19af-4284-9952-ab7d7bda2621', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f5e38-e0ea-40f8-801c-f92dfd0626bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (287f5e38-e0ea-40f8-801c-f92dfd0626bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5875de8-f8e1-4f82-8155-6b5853f1bc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Volume afef07de-19af-4284-9952-ab7d7bda2621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afef07de-19af-4284-9952-ab7d7bda2621', 'volume_size': 1} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:13 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d" returned: 0 in 0.741s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1659085592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c3e1c8-8c83-4d8e-8ce9-cea39c633002,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9893f50a291a456a8945a8434c3a2b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:12Z,use_quota=True,user_id='32c45e90715744b7b52c754c9e40039c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Creating volume 19c3e1c8-8c83-4d8e-8ce9-cea39c633002 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:13 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:13 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 1073741824 Jul 07 09:20:13 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667f98a2-d73c-4f9e-a2ad-7dd4604ad5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8445a6-ec39-4d44-b806-7b1eafc8dae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Volume volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d (8c5f45a6-c991-4e2c-9368-2aeff29f110d): created successfully Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8445a6-ec39-4d44-b806-7b1eafc8dae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (420f9f0d-bdb4-4744-a763-42295722c70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d205b368-e85b-4ea0-bf89-5d7a5837a314 tempest-VolumesActionsTest-1986577943 None] Created volume successfully. Jul 07 09:20:13 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b" returned: 0 in 0.791s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:13 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b Jul 07 09:20:13 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:14 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 1073741824" returned: 0 in 0.818s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:14 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 Jul 07 09:20:14 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:14 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-64b647ac-89a5-4184-a17d-47773449710b" returned: 0 in 0.676s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-quobyte-64b647ac-89a5-4184-a17d-47773449710b" released by "delete_volume" :: held 1.542s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Created reservations ['1d00bc14-4ad5-45a6-b636-f905ddda95f3', '2d898e52-aad6-4b15-b6ab-c34cb7803ab4', '4a4d591e-fd47-41f1-ba05-e0ea24bb85f5', 'a9634e3f-dd67-4318-a332-7a0fbf2195eb'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:14 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:14 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-8c5f45a6-c991-4e2c-9368-2aeff29f110d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Lock "cinder-8c5f45a6-c991-4e2c-9368-2aeff29f110d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Acquiring lock "cinder-quobyte-8c5f45a6-c991-4e2c-9368-2aeff29f110d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-8c5f45a6-c991-4e2c-9368-2aeff29f110d" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[41498751-c1c6-4598-b6d8-f34fbe5d550a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:15 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d Jul 07 09:20:15 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:15 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002" returned: 0 in 0.683s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-2068037121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afef07de-19af-4284-9952-ab7d7bda2621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e8a9f8a08a46ad901ded278d045500',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:13Z,use_quota=True,user_id='c39d896b053a435e81028784aff61e16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Creating volume afef07de-19af-4284-9952-ab7d7bda2621 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:15 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:15 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 1073741824 Jul 07 09:20:15 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61ddd91-1f42-4d3b-9b4c-716ea6c94fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ca4047-0df9-4841-a1c7-630143cbfa96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:15 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Volume volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 (19c3e1c8-8c83-4d8e-8ce9-cea39c633002): created successfully Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ca4047-0df9-4841-a1c7-630143cbfa96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Flow 'volume_create_manager' (74bd53d5-1db2-4e8a-a3c8-f3db38dce892) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4904cbe2-1322-45a8-9a27-275b50e8ab60 tempest-VolumesNegativeTest-1670732866 None] Created volume successfully. Jul 07 09:20:15 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.818s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Deleted volume successfully. Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-59874310-215c-4ab1-972c-ee62a27c2737 tempest-AttachVolumeTestJSON-1171211741 None] Lock "cinder-64b647ac-89a5-4184-a17d-47773449710b-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:15 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d" returned: 0 in 0.961s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:15 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d Jul 07 09:20:15 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:16 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 1073741824" returned: 0 in 1.081s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:16 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 Jul 07 09:20:16 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:16 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c5f45a6-c991-4e2c-9368-2aeff29f110d" returned: 0 in 0.822s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Lock "cinder-quobyte-8c5f45a6-c991-4e2c-9368-2aeff29f110d" released by "delete_volume" :: held 1.836s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Created reservations ['7b400284-2a2a-489f-8b12-cf08dceed794', '38cefb5f-c6f3-426f-b46d-533b7d7fe5d2', 'ab3cc0a2-cee6-430a-b2fe-59910dc9857c', 'a48542a2-c6ca-4029-9e44-cc8d0e362b04'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:16 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:16 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:17 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621" returned: 0 in 0.948s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] <== create_volume: return (2078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.080s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5875de8-f8e1-4f82-8155-6b5853f1bc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afef07de-19af-4284-9952-ab7d7bda2621', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebde065-5afb-4efd-b903-2c2036258cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:17 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Volume volume-afef07de-19af-4284-9952-ab7d7bda2621 (afef07de-19af-4284-9952-ab7d7bda2621): created successfully Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bebde065-5afb-4efd-b903-2c2036258cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Flow 'volume_create_manager' (617d2fe6-39be-4914-94c3-aff694316d1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c4e1e7cd-d69f-45af-8d5f-ec3525aa38ac tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Created volume successfully. Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (9be4fad1-de94-406f-9e37-f7efad7d3433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250767b2-56f8-4a27-9a94-bc8f57ac1fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:17 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (250767b2-56f8-4a27-9a94-bc8f57ac1fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430015374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18336ac-b723-4968-b017-4117c5f88ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:18Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816edf09-1910-4e25-827a-e20fa957e5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (816edf09-1910-4e25-827a-e20fa957e5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8027bb9c-c331-48e8-accf-a5906f7fa943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8027bb9c-c331-48e8-accf-a5906f7fa943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18336ac-b723-4968-b017-4117c5f88ea1', 'volume_name': 'volume-f18336ac-b723-4968-b017-4117c5f88ea1', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b10efa-23c7-4c3e-955f-37f6ad1903eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70b10efa-23c7-4c3e-955f-37f6ad1903eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0653c8-7da2-491f-9ddd-cdc79c23de68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:17 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Volume f18336ac-b723-4968-b017-4117c5f88ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18336ac-b723-4968-b017-4117c5f88ea1', 'volume_size': 1} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-430015374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18336ac-b723-4968-b017-4117c5f88ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7fdc4493bef472898435447fbfdd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:18Z,use_quota=True,user_id='722a948015084e318a8ceb200e13f6b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Creating volume f18336ac-b723-4968-b017-4117c5f88ea1 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:17 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.038s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:17 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:17 devstack sudo[97446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 1073741824 Jul 07 09:20:17 devstack sudo[97446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Deleted volume successfully. Jul 07 09:20:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9403bac2-2f83-4828-b99b-903348357309 tempest-VolumesActionsTest-747667661 None] Lock "cinder-8c5f45a6-c991-4e2c-9368-2aeff29f110d-delete_volume" released by "delete_volume" :: held 3.217s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:18 devstack sudo[97446]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 1073741824" returned: 0 in 1.010s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:19 devstack sudo[97452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 Jul 07 09:20:19 devstack sudo[97452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:19 devstack sudo[97452]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1" returned: 0 in 0.740s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd0653c8-7da2-491f-9ddd-cdc79c23de68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18336ac-b723-4968-b017-4117c5f88ea1', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db9148d-4c96-42b2-b277-14ddd85826bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Volume volume-f18336ac-b723-4968-b017-4117c5f88ea1 (f18336ac-b723-4968-b017-4117c5f88ea1): created successfully Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db9148d-4c96-42b2-b277-14ddd85826bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Flow 'volume_create_manager' (9be4fad1-de94-406f-9e37-f7efad7d3433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:19 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-64640a26-3d5d-4b5d-837b-538d7b145b77 tempest-VolumesActionsTest-1986577943 None] Created volume successfully. Jul 07 09:20:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "cinder-f18336ac-b723-4968-b017-4117c5f88ea1-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-f18336ac-b723-4968-b017-4117c5f88ea1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "cinder-quobyte-f18336ac-b723-4968-b017-4117c5f88ea1" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-quobyte-f18336ac-b723-4968-b017-4117c5f88ea1" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56160b6-a0ec-4439-8e25-2504220a6602]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:20 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 Jul 07 09:20:20 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:21 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[51613fd7-4590-486e-be1d-4d17b09c34b5]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:21 devstack sudo[97466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 Jul 07 09:20:21 devstack sudo[97466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:21 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1" returned: 0 in 1.075s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:21 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1 Jul 07 09:20:21 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:22 devstack sudo[97466]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621" returned: 0 in 1.011s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.038s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-afef07de-19af-4284-9952-ab7d7bda2621', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b930ad76-b370-4bcf-a144-256b414732b8', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:20:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-4540a77d-fa9c-435a-aadd-d4cf72f341df req-70420248-7dd3-4e95-b8e7-53fe601df1e9 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] attachment_update completed successfully. Jul 07 09:20:22 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f18336ac-b723-4968-b017-4117c5f88ea1" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-quobyte-f18336ac-b723-4968-b017-4117c5f88ea1" released by "delete_volume" :: held 1.958s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Created reservations ['ad22707c-f5f4-4d70-8762-35e76a9ec5e4', '2a93037c-b470-47a4-a306-63545d870533', '3b3c08ec-bc97-4a49-8054-e7dd0d1626cc', 'c4092320-e025-417b-9836-1ec73a069f58'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:23 devstack sudo[97545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:23 devstack sudo[97545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:23 devstack sudo[97545]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.947s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:23 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Deleted volume successfully. Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-127162ca-84e1-452c-aed0-dcf14418585e tempest-VolumesActionsTest-1986577943 None] Lock "cinder-f18336ac-b723-4968-b017-4117c5f88ea1-delete_volume" released by "delete_volume" :: held 3.444s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=126,cinder:UPDATE=157,cinder:INSERT=38,cinder:DELETE=9 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Flow 'volume_create_manager' (f18e935b-9ced-4158-b327-3a70f4929fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ee7ee-4a5d-480e-9f07-527e69b3659f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (029ee7ee-4a5d-480e-9f07-527e69b3659f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-144031992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164b4fb4-d5d8-4a28-a68e-682c6f526137,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fdd5b2ae24feb996511281e68a6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:24Z,use_quota=True,user_id='b9bfbc36be954227bdeda7e067bba130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1043cc76-21df-46f1-9abe-4be2b80152b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1043cc76-21df-46f1-9abe-4be2b80152b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3461794a-9a04-459c-b16b-e160e236fcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3461794a-9a04-459c-b16b-e160e236fcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '164b4fb4-d5d8-4a28-a68e-682c6f526137', 'volume_name': 'volume-164b4fb4-d5d8-4a28-a68e-682c6f526137', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20df237-68fb-4ef6-8749-c9bcf12fe749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20df237-68fb-4ef6-8749-c9bcf12fe749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be40b146-0f77-4bbf-b918-bc616ba953bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:24 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Volume 164b4fb4-d5d8-4a28-a68e-682c6f526137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-164b4fb4-d5d8-4a28-a68e-682c6f526137', 'volume_size': 1} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-144031992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=164b4fb4-d5d8-4a28-a68e-682c6f526137,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fdd5b2ae24feb996511281e68a6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:24Z,use_quota=True,user_id='b9bfbc36be954227bdeda7e067bba130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Creating volume 164b4fb4-d5d8-4a28-a68e-682c6f526137 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:24 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:24 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 1073741824 Jul 07 09:20:24 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:25 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 1073741824" returned: 0 in 1.016s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:25 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 Jul 07 09:20:25 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:26 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137" returned: 0 in 0.757s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.831s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be40b146-0f77-4bbf-b918-bc616ba953bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-164b4fb4-d5d8-4a28-a68e-682c6f526137', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b6a4eb-db4d-424d-b8cd-8ca2c4a30e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:26 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Volume volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 (164b4fb4-d5d8-4a28-a68e-682c6f526137): created successfully Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1b6a4eb-db4d-424d-b8cd-8ca2c4a30e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Flow 'volume_create_manager' (f18e935b-9ced-4158-b327-3a70f4929fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ca7d4f97-c3d4-47fc-919a-77accb9f4d0a tempest-VolumesTestJSON-62315371 None] Created volume successfully. Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:26 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:26 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Flow 'volume_create_manager' (92c325a6-4d64-4144-a14a-57f04273f55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab817b96-3048-44d9-b812-1490cf4be1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab817b96-3048-44d9-b812-1490cf4be1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-473504694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3a2361-b348-47dc-bde7-6de7d8f262cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fdd5b2ae24feb996511281e68a6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:27Z,use_quota=True,user_id='b9bfbc36be954227bdeda7e067bba130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a731f944-af86-4eac-b305-6092d2e8086c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a731f944-af86-4eac-b305-6092d2e8086c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b0b228-8f50-4512-a296-f14498729f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46b0b228-8f50-4512-a296-f14498729f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca3a2361-b348-47dc-bde7-6de7d8f262cc', 'volume_name': 'volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65006cf2-4b0e-46fa-b6cb-981b60347b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65006cf2-4b0e-46fa-b6cb-981b60347b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2a6482-2715-4f7d-845b-ef5db0669ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:27 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Volume ca3a2361-b348-47dc-bde7-6de7d8f262cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc', 'volume_size': 1} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-473504694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca3a2361-b348-47dc-bde7-6de7d8f262cc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fdd5b2ae24feb996511281e68a6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:27Z,use_quota=True,user_id='b9bfbc36be954227bdeda7e067bba130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Creating volume ca3a2361-b348-47dc-bde7-6de7d8f262cc {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:27 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:27 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc 1073741824 Jul 07 09:20:27 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:27 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.009s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:20:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:20:28 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc 1073741824" returned: 0 in 1.298s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:29 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc Jul 07 09:20:29 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:29 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc" returned: 0 in 0.738s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] <== create_volume: return (2173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.176s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d2a6482-2715-4f7d-845b-ef5db0669ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee875f-67d1-49c3-8cd6-cb8e038f4711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:29 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Volume volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc (ca3a2361-b348-47dc-bde7-6de7d8f262cc): created successfully Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ee875f-67d1-49c3-8cd6-cb8e038f4711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Flow 'volume_create_manager' (92c325a6-4d64-4144-a14a-57f04273f55e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-824dad5a-973e-4d59-84b4-f636b39f8180 tempest-VolumesTestJSON-62315371 None] Created volume successfully. Jul 07 09:20:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-dcc7b424-9eae-4952-b4a3-e5bd351094a7 req-b591e48d-89e3-461a-9fad-b2628ee3e454 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Terminate volume connection completed successfully. Jul 07 09:20:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-dcc7b424-9eae-4952-b4a3-e5bd351094a7 req-b591e48d-89e3-461a-9fad-b2628ee3e454 tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Deleting attachment b930ad76-b370-4bcf-a144-256b414732b8. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Flow 'volume_create_manager' (f62e95e2-b9fa-4fa3-b70f-def97fc06e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22509cfc-83df-4e68-a318-30186503119b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22509cfc-83df-4e68-a318-30186503119b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1442198220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc96d9cb-bd03-4938-ad74-05e35f5f5d0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fdd5b2ae24feb996511281e68a6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:32Z,use_quota=True,user_id='b9bfbc36be954227bdeda7e067bba130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52796469-31a6-440b-9999-ecff54110d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52796469-31a6-440b-9999-ecff54110d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb438e9-51c0-4eda-af4f-374b9aab4e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb438e9-51c0-4eda-af4f-374b9aab4e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc96d9cb-bd03-4938-ad74-05e35f5f5d0d', 'volume_name': 'volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ac0841-1016-436c-b30c-031f97f6a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ac0841-1016-436c-b30c-031f97f6a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6e805-c693-42f5-a8b9-ba7319e14b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:31 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Volume cc96d9cb-bd03-4938-ad74-05e35f5f5d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d', 'volume_size': 1} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1442198220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc96d9cb-bd03-4938-ad74-05e35f5f5d0d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6e4fdd5b2ae24feb996511281e68a6a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:32Z,use_quota=True,user_id='b9bfbc36be954227bdeda7e067bba130',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Creating volume cc96d9cb-bd03-4938-ad74-05e35f5f5d0d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:31 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:31 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d 1073741824 Jul 07 09:20:31 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Acquiring lock "cinder-afef07de-19af-4284-9952-ab7d7bda2621-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "cinder-afef07de-19af-4284-9952-ab7d7bda2621-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Acquiring lock "cinder-quobyte-afef07de-19af-4284-9952-ab7d7bda2621" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "cinder-quobyte-afef07de-19af-4284-9952-ab7d7bda2621" acquired by "delete_volume" :: waited 0.045s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6be487e-badc-41ab-886d-e285019b039b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:32 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 Jul 07 09:20:32 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:33 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d 1073741824" returned: 0 in 1.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:33 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d Jul 07 09:20:33 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:33 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621" returned: 0 in 1.349s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:34 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621 Jul 07 09:20:34 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:34 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d" returned: 0 in 1.288s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] <== create_volume: return (3103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.108s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b6e805-c693-42f5-a8b9-ba7319e14b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e599c6-fc11-441b-91b1-83cf145bee7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:34 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Volume volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d (cc96d9cb-bd03-4938-ad74-05e35f5f5d0d): created successfully Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62e599c6-fc11-441b-91b1-83cf145bee7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Flow 'volume_create_manager' (f62e95e2-b9fa-4fa3-b70f-def97fc06e7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4f2f0d69-7c3c-4cea-9ae6-d44b9a04bc54 tempest-VolumesTestJSON-62315371 None] Created volume successfully. Jul 07 09:20:35 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afef07de-19af-4284-9952-ab7d7bda2621" returned: 0 in 1.079s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "cinder-quobyte-afef07de-19af-4284-9952-ab7d7bda2621" released by "delete_volume" :: held 2.481s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Created reservations ['18da007a-88d4-4934-80b1-cbdd9a4d51ce', '3f4aa81a-6dba-49b5-939b-db6560d8b5c8', 'b0c22740-bc0a-4715-aa95-b9539c56a93f', 'b8187e5a-5676-47cf-9910-8691e740ec3f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:35 devstack sudo[98036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:35 devstack sudo[98036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:36 devstack sudo[98036]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.858s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:36 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Deleted volume successfully. Jul 07 09:20:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ffb2956-be32-473f-966d-652fbe054c9f tempest-TestServerVolumeAttachScenarioOldVersion-1708775222 None] Lock "cinder-afef07de-19af-4284-9952-ab7d7bda2621-delete_volume" released by "delete_volume" :: held 3.649s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Acquiring lock "cinder-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Lock "cinder-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Acquiring lock "cinder-quobyte-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Lock "cinder-quobyte-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2094b6-74ef-4faf-b848-61e6701d0454]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:37 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d Jul 07 09:20:37 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:38 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d" returned: 0 in 1.108s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:38 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d Jul 07 09:20:38 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:39 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d" returned: 0 in 0.789s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Lock "cinder-quobyte-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d" released by "delete_volume" :: held 1.947s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Created reservations ['a51c26cd-d09a-4975-ae67-e6255c004481', 'a4cb031d-3bcf-45e4-a9d4-a98dec0ae8e7', '0ebb6b21-bb66-4590-b0b3-c53cf4b75b73', 'bd4c611e-ab57-4985-aa42-e043198be4d6'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:39 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:39 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Acquiring lock "cinder-ca3a2361-b348-47dc-bde7-6de7d8f262cc-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Lock "cinder-ca3a2361-b348-47dc-bde7-6de7d8f262cc-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Acquiring lock "cinder-quobyte-ca3a2361-b348-47dc-bde7-6de7d8f262cc" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Lock "cinder-quobyte-ca3a2361-b348-47dc-bde7-6de7d8f262cc" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc096f7-b1f1-4ec9-94b4-11a02eeecee1]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:40 devstack sudo[98126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc Jul 07 09:20:40 devstack sudo[98126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:40 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.823s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:40 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Deleted volume successfully. Jul 07 09:20:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-acb4d9b6-2dc3-4e82-8d46-d55b1a7924fe tempest-VolumesTestJSON-62315371 None] Lock "cinder-cc96d9cb-bd03-4938-ad74-05e35f5f5d0d-delete_volume" released by "delete_volume" :: held 3.062s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:41 devstack sudo[98126]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:41 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc Jul 07 09:20:41 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:41 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ca3a2361-b348-47dc-bde7-6de7d8f262cc" returned: 0 in 0.777s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Lock "cinder-quobyte-ca3a2361-b348-47dc-bde7-6de7d8f262cc" released by "delete_volume" :: held 1.637s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:41 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Created reservations ['4341a438-5316-4bf6-8a8a-240a92f2061b', '49cf2eae-3f93-42e8-b53b-2f0253655777', '88c09913-e387-4ce1-9a9d-895a69dafa9e', 'f06c1d6f-3197-4605-a3bd-b513a420bfd6'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Flow 'volume_create_manager' (38990d4f-ea54-4413-a46a-0e998fb5f3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad73cd85-b724-47ab-8828-ca777f8953f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad73cd85-b724-47ab-8828-ca777f8953f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-425985212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd5a332-bd18-45a5-87e3-c6c4368efb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee98559077449ea8b3d337e19d26b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:42Z,use_quota=True,user_id='a55ca21c26bf4e5cb3bda3e9b48cc460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5f6787-71b4-4d35-96f1-7685e1b39009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e5f6787-71b4-4d35-96f1-7685e1b39009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3885e39-0fe1-4718-bed8-7d0a8bc5f877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3885e39-0fe1-4718-bed8-7d0a8bc5f877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecd5a332-bd18-45a5-87e3-c6c4368efb7b', 'volume_name': 'volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1412e478-ba02-4ce7-8062-16cf63e00e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1412e478-ba02-4ce7-8062-16cf63e00e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b8ca85-6376-4585-9df3-733a95136c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:42 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Volume ecd5a332-bd18-45a5-87e3-c6c4368efb7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b', 'volume_size': 1} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-425985212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecd5a332-bd18-45a5-87e3-c6c4368efb7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee98559077449ea8b3d337e19d26b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:20:42Z,use_quota=True,user_id='a55ca21c26bf4e5cb3bda3e9b48cc460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Creating volume ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:20:42 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:42 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b 1073741824 Jul 07 09:20:42 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:42 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:42 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Acquiring lock "cinder-164b4fb4-d5d8-4a28-a68e-682c6f526137-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Lock "cinder-164b4fb4-d5d8-4a28-a68e-682c6f526137-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Acquiring lock "cinder-quobyte-164b4fb4-d5d8-4a28-a68e-682c6f526137" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Lock "cinder-quobyte-164b4fb4-d5d8-4a28-a68e-682c6f526137" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b25168-1367-42e7-aa11-ebd4fff5f30c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:42 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 Jul 07 09:20:42 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:43 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Deleted volume successfully. Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a7968c7d-8770-4c75-9434-7fd266febb09 tempest-VolumesTestJSON-62315371 None] Lock "cinder-ca3a2361-b348-47dc-bde7-6de7d8f262cc-delete_volume" released by "delete_volume" :: held 2.923s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:43 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b 1073741824" returned: 0 in 1.059s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:43 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b Jul 07 09:20:43 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:43 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137" returned: 0 in 0.931s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:43 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137 Jul 07 09:20:43 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:43 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" returned: 0 in 0.771s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] <== create_volume: return (1877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:20:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8b8ca85-6376-4585-9df3-733a95136c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a388db1f-6da5-4d85-abc6-63ea448a7c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:20:44 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Volume volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b (ecd5a332-bd18-45a5-87e3-c6c4368efb7b): created successfully Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a388db1f-6da5-4d85-abc6-63ea448a7c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Flow 'volume_create_manager' (38990d4f-ea54-4413-a46a-0e998fb5f3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:20:44 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-24814012-2683-4aa1-bcba-39b8f1e2c3dd tempest-SnapshotMetadataTestJSON-166772369 None] Created volume successfully. Jul 07 09:20:44 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-164b4fb4-d5d8-4a28-a68e-682c6f526137" returned: 0 in 0.756s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Lock "cinder-quobyte-164b4fb4-d5d8-4a28-a68e-682c6f526137" released by "delete_volume" :: held 1.736s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Created reservations ['ec403f03-57be-47fd-a9a2-3899bc9e12b8', '4e870bbb-be12-4c03-998e-4134485c48d3', '148dfc01-8b5f-4dcf-8ba3-cb5c0f1767c9', 'b269a5fa-3e96-4c87-ae1b-d441f98efa67'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:44 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:44 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:45 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.870s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Deleted volume successfully. Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fa951420-3d64-4a3c-a8c9-ab91533fa42c tempest-VolumesTestJSON-62315371 None] Lock "cinder-164b4fb4-d5d8-4a28-a68e-682c6f526137-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Creating offline snapshot e3caa0a6-4be8-4074-be09-6d03cb2b0376 of volume ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8eedf2-c01f-4ca7-9f03-6733db30ae62]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:45 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b Jul 07 09:20:45 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:46 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" returned: 0 in 1.011s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:46 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 1G Jul 07 09:20:46 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:47 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 1G" returned: 0 in 1.094s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:47 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 Jul 07 09:20:47 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:48 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376" returned: 0 in 0.923s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:48 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 is being set with open permissions: ugo+rw Jul 07 09:20:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:48 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 Jul 07 09:20:48 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:49 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376" returned: 0 in 0.868s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=171,cinder:DELETE=19,cinder:SELECT=109,cinder:INSERT=32 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:49 devstack sudo[98185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info Jul 07 09:20:49 devstack sudo[98185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Acquiring lock "cinder-19c3e1c8-8c83-4d8e-8ce9-cea39c633002-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Lock "cinder-19c3e1c8-8c83-4d8e-8ce9-cea39c633002-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Acquiring lock "cinder-quobyte-19c3e1c8-8c83-4d8e-8ce9-cea39c633002" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Lock "cinder-quobyte-19c3e1c8-8c83-4d8e-8ce9-cea39c633002" acquired by "delete_volume" :: waited 0.034s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d7a09e-7e81-4ab1-936c-22ffabe751c2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:50 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 Jul 07 09:20:50 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:50 devstack sudo[98185]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:50 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info is being set with open permissions: ugo+rw Jul 07 09:20:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:50 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info Jul 07 09:20:50 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1a6f6c90-133c-4c30-a1a6-23c4b6a35dba tempest-BackendsCapabilitiesAdminTestsJSON-1154526050 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 09:20:50 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002" returned: 0 in 0.845s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:50 devstack sudo[98196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002 Jul 07 09:20:50 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:51 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.info" returned: 0 in 0.698s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.526s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ce7a0938-1e5b-4ced-bf67-df42085ef677 tempest-SnapshotMetadataTestJSON-166772369 None] Create snapshot completed successfully Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-66796b11-4e55-4962-a60b-b043b0ccb604 tempest-BackendsCapabilitiesAdminTestsJSON-1154526050 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 09:20:51 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-19c3e1c8-8c83-4d8e-8ce9-cea39c633002" returned: 0 in 0.706s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Lock "cinder-quobyte-19c3e1c8-8c83-4d8e-8ce9-cea39c633002" released by "delete_volume" :: held 1.596s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Created reservations ['3d98f5c7-05e3-48d5-b8c8-298d4fe125bb', '792513f4-946d-4839-aede-0a135d3970d6', 'abedb2f5-121e-433c-85da-56f87a72b308', 'b3a051bf-63b7-4363-b813-03f5b4e7cec4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:51 devstack sudo[98202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:51 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:52 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.856s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:52 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:20:52 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Deleted volume successfully. Jul 07 09:20:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7294038c-4350-4eee-8b28-e3851b231338 tempest-VolumesNegativeTest-1670732866 None] Lock "cinder-19c3e1c8-8c83-4d8e-8ce9-cea39c633002-delete_volume" released by "delete_volume" :: held 2.738s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "cinder-e3caa0a6-4be8-4074-be09-6d03cb2b0376-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-e3caa0a6-4be8-4074-be09-6d03cb2b0376-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "cinder-quobyte-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-quobyte-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "cinder-quobyte-e3caa0a6-4be8-4074-be09-6d03cb2b0376" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-quobyte-e3caa0a6-4be8-4074-be09-6d03cb2b0376" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Deleting offline snapshot e3caa0a6-4be8-4074-be09-6d03cb2b0376 of volume ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] snapshot_file for this snap is: volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6bdcbd-d693-4730-b06b-66cfbc305d3a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:53 devstack sudo[98205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 Jul 07 09:20:53 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:54 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376" returned: 0 in 0.854s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:20:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[232031a4-3550-4411-912e-b91961f33efa]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:54 devstack sudo[98210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b Jul 07 09:20:54 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:55 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" returned: 0 in 1.057s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:55 devstack sudo[98216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 Jul 07 09:20:55 devstack sudo[98216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:56 devstack sudo[98216]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376" returned: 0 in 0.888s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:56 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376 Jul 07 09:20:56 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:56 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b.e3caa0a6-4be8-4074-be09-6d03cb2b0376" returned: 0 in 0.677s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-quobyte-e3caa0a6-4be8-4074-be09-6d03cb2b0376" released by "_delete_snapshot" :: held 3.632s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-quobyte-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" released by "delete_snapshot" :: held 3.661s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Created reservations ['8b1dc22b-1c79-42e8-93e6-1bbc54f209ad', '42ae47c9-6152-48f8-8d59-2310f2f5ebd4', '9f3e298c-55be-4ce3-93c5-bf6d3716634f', 'ba128ef4-39f2-4980-af74-3a87b2a56520'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Delete snapshot completed successfully. Jul 07 09:20:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7152376a-dcc7-4636-9e6d-8368038391e8 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-e3caa0a6-4be8-4074-be09-6d03cb2b0376-delete_snapshot" released by "delete_snapshot" :: held 3.829s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "cinder-ecd5a332-bd18-45a5-87e3-c6c4368efb7b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-ecd5a332-bd18-45a5-87e3-c6c4368efb7b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "cinder-quobyte-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:20:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-quobyte-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:20:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73048fc-2639-4e58-8f4b-52afd3a2dbdf]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:20:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:57 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b Jul 07 09:20:57 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:58 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" returned: 0 in 0.914s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:58 devstack sudo[98230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b Jul 07 09:20:58 devstack sudo[98230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:59 devstack sudo[98230]: pam_unix(sudo:session): session closed for user root Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-quobyte-ecd5a332-bd18-45a5-87e3-c6c4368efb7b" released by "delete_volume" :: held 1.783s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Created reservations ['57365bd0-d44e-451e-a839-e97849da57af', 'a9944003-3af9-449e-9687-27b63b63593c', '0f6f119c-e67e-4ad1-9b5e-796e68efd982', 'b926dfb5-a78f-4b72-949e-aa271ca3d2bd'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:20:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:20:59 devstack sudo[98233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:20:59 devstack sudo[98233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:20:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7e9a0fc0-a606-4b3e-8514-b288e40ed234 tempest-GroupsTest-1813426629 None] Group tempest-Group1-1624019081: creating Jul 07 09:20:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7e9a0fc0-a606-4b3e-8514-b288e40ed234 tempest-GroupsTest-1813426629 None] Group tempest-Group1-1624019081: created successfully Jul 07 09:20:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7e9a0fc0-a606-4b3e-8514-b288e40ed234 tempest-GroupsTest-1813426629 None] Create group completed successfully. Jul 07 09:21:00 devstack sudo[98233]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:00 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:00 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Deleted volume successfully. Jul 07 09:21:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ae332591-e07b-43aa-9654-ce4b4c32b056 tempest-SnapshotMetadataTestJSON-166772369 None] Lock "cinder-ecd5a332-bd18-45a5-87e3-c6c4368efb7b-delete_volume" released by "delete_volume" :: held 2.919s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9a065f21-59bc-4c46-b7c8-8037b049ba42 tempest-GroupsTest-1813426629 None] Group tempest-Group2-1772105616: creating Jul 07 09:21:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9a065f21-59bc-4c46-b7c8-8037b049ba42 tempest-GroupsTest-1813426629 None] Group tempest-Group2-1772105616: created successfully Jul 07 09:21:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9a065f21-59bc-4c46-b7c8-8037b049ba42 tempest-GroupsTest-1813426629 None] Create group completed successfully. Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Flow 'volume_create_manager' (3e13b931-3279-42ee-99d6-ef7e95c1d942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a55a901-e3c8-4dbc-aad1-1056076c588b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a55a901-e3c8-4dbc-aad1-1056076c588b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76c7450-c95a-4ccf-8591-f1d00e75a5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240a79bce6df49be8d73ff7e227c2bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:02Z,use_quota=True,user_id='5e8597ba114c44a298724e280aa136bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41087a94-641f-4e0f-81ff-78845b5ccacd),volume_type_id=41087a94-641f-4e0f-81ff-78845b5ccacd)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496af560-a4b8-433c-8120-fbadccceedb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (496af560-a4b8-433c-8120-fbadccceedb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e65b9-fe4a-4742-ba37-7a75e4e5b5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:01 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (438e65b9-fe4a-4742-ba37-7a75e4e5b5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c76c7450-c95a-4ccf-8591-f1d00e75a5c6', 'volume_name': 'volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6', 'volume_size': 1, 'image_id': 'a452109d-7672-4053-bbf4-d72754d70456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a452109d-7672-4053-bbf4-d72754d70456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e7cb9966a8dfea123f86f695e1095999', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '240a79bce6df49be8d73ff7e227c2bb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce4b61cf636bffd8040066fffc7c9e5d666ae8d23a7001f82800541a9f8f6fdaded5be250b2310839e226b2e42c9cddb6063fe135cd00b0b38a55d57ebfeb6be', 'id': 'a452109d-7672-4053-bbf4-d72754d70456', 'created_at': datetime.datetime(2026, 7, 7, 7, 20, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 21, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a452109d-7672-4053-bbf4-d72754d70456/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225c4381-b04b-4e4b-80fa-31c8fef12b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (225c4381-b04b-4e4b-80fa-31c8fef12b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a712862-bafd-487c-b236-e82f70fa4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:02 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Volume c76c7450-c95a-4ccf-8591-f1d00e75a5c6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6', 'volume_size': 1, 'image_id': 'a452109d-7672-4053-bbf4-d72754d70456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a452109d-7672-4053-bbf4-d72754d70456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e7cb9966a8dfea123f86f695e1095999', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '240a79bce6df49be8d73ff7e227c2bb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce4b61cf636bffd8040066fffc7c9e5d666ae8d23a7001f82800541a9f8f6fdaded5be250b2310839e226b2e42c9cddb6063fe135cd00b0b38a55d57ebfeb6be', 'id': 'a452109d-7672-4053-bbf4-d72754d70456', 'created_at': datetime.datetime(2026, 7, 7, 7, 20, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 21, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a452109d-7672-4053-bbf4-d72754d70456/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Trying to clone c76c7450-c95a-4ccf-8591-f1d00e75a5c6 from image a452109d-7672-4053-bbf4-d72754d70456 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a452109d-7672-4053-bbf4-d72754d70456', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Flow 'volume_create_manager' (47d80238-dbcd-44fb-ab06-384fc339a4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca27e22b-98f7-420c-8e2e-e7fdbb38c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca27e22b-98f7-420c-8e2e-e7fdbb38c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611812864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8547f609-f630-40b3-ae39-f456074539f1,host='devstack@QuobyteHD#QuobyteHD',id=604b66e6-33cf-4b75-b677-a4b42cdc2a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ec864a6fd4c08b59eb2e2ca46237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:03Z,use_quota=True,user_id='b1f4590ac3e54097a94c3a234588d35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5affeaf9-5844-4b89-ae74-6d81a3f32215),volume_type_id=5affeaf9-5844-4b89-ae74-6d81a3f32215)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e4123c-575e-439a-87fc-4bb8259e9df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e4123c-575e-439a-87fc-4bb8259e9df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009beb0a-d532-4a3f-a3ce-78edc27d871c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (009beb0a-d532-4a3f-a3ce-78edc27d871c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '604b66e6-33cf-4b75-b677-a4b42cdc2a28', 'volume_name': 'volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9424960-85d9-4b75-ad99-171d86c95a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9424960-85d9-4b75-ad99-171d86c95a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607a0995-0b20-478d-803b-faca84f91006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:03 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Volume 604b66e6-33cf-4b75-b677-a4b42cdc2a28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28', 'volume_size': 1} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8547f609-f630-40b3-ae39-f456074539f1,created_at=2026-07-07T07:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611812864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8547f609-f630-40b3-ae39-f456074539f1,host='devstack@QuobyteHD#QuobyteHD',id=604b66e6-33cf-4b75-b677-a4b42cdc2a28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ec864a6fd4c08b59eb2e2ca46237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:03Z,use_quota=True,user_id='b1f4590ac3e54097a94c3a234588d35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5affeaf9-5844-4b89-ae74-6d81a3f32215),volume_type_id=5affeaf9-5844-4b89-ae74-6d81a3f32215)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Creating volume 604b66e6-33cf-4b75-b677-a4b42cdc2a28 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:03 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:21:03 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Image download 0.00 MB at 0.00 MB/s Jul 07 09:21:03 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 1073741824 Jul 07 09:21:03 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8988384-e858-4b22-897d-610e9995b15e]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:03 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD Jul 07 09:21:03 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:04 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 1073741824" returned: 0 in 1.210s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:04 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD" returned: 0 in 1.178s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:04 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 Jul 07 09:21:04 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:04 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD Jul 07 09:21:04 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:05 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28" returned: 0 in 0.799s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (607a0995-0b20-478d-803b-faca84f91006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ac33c7-77e5-4769-be74-be7038b00597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Volume volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 (604b66e6-33cf-4b75-b677-a4b42cdc2a28): created successfully Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7ac33c7-77e5-4769-be74-be7038b00597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Flow 'volume_create_manager' (47d80238-dbcd-44fb-ab06-384fc339a4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:05 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a198fec1-783d-4cb9-a41a-00453fa30ad6 tempest-GroupsTest-1813426629 None] Created volume successfully. Jul 07 09:21:05 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD" returned: 1 in 1.039s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Temporary image a452109d-7672-4053-bbf4-d72754d70456 is fetched for user 5e8597ba114c44a298724e280aa136bb. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc02471a-01aa-4583-a354-f8a8acdfa1c2]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:05 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD Jul 07 09:21:05 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Acquiring lock "cinder-quobyte-604b66e6-33cf-4b75-b677-a4b42cdc2a28" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Lock "cinder-quobyte-604b66e6-33cf-4b75-b677-a4b42cdc2a28" acquired by "delete_volume" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fd6d99-795f-465f-9fcd-4461797272f4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:06 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 Jul 07 09:21:06 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:06 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD" returned: 0 in 1.120s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:06 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD Jul 07 09:21:06 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Flow 'volume_create_manager' (67f684a0-d098-4769-89d8-6baabba3bbd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a54aba8-1eea-46b5-b846-f18dcf5071f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a54aba8-1eea-46b5-b846-f18dcf5071f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2143078609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5864ec25-3aa0-4324-a75e-986ef6deecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e8c39c22cd4e71b489dacd90b062be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:07Z,use_quota=True,user_id='f9e3b497820b43e9bc32d5de6e879e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf4f03-6383-4667-847c-68aaa9d713fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34bf4f03-6383-4667-847c-68aaa9d713fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d310bee7-63df-4f70-b73b-5a90c3d1adf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d310bee7-63df-4f70-b73b-5a90c3d1adf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5864ec25-3aa0-4324-a75e-986ef6deecbe', 'volume_name': 'volume-5864ec25-3aa0-4324-a75e-986ef6deecbe', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0563fd5f-9a75-4bdc-af89-c05f4d861f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0563fd5f-9a75-4bdc-af89-c05f4d861f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c233774e-6c59-44be-a94b-2042ea0d5f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:07 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Volume 5864ec25-3aa0-4324-a75e-986ef6deecbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5864ec25-3aa0-4324-a75e-986ef6deecbe', 'volume_size': 1} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2143078609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5864ec25-3aa0-4324-a75e-986ef6deecbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e8c39c22cd4e71b489dacd90b062be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:07Z,use_quota=True,user_id='f9e3b497820b43e9bc32d5de6e879e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Creating volume 5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:07 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:07 devstack sudo[98268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe 1073741824 Jul 07 09:21:07 devstack sudo[98268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:07 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28" returned: 0 in 0.960s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:07 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28 Jul 07 09:21:07 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:07 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD" returned: 1 in 1.260s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:21:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:08 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-604b66e6-33cf-4b75-b677-a4b42cdc2a28" returned: 0 in 0.766s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Lock "cinder-quobyte-604b66e6-33cf-4b75-b677-a4b42cdc2a28" released by "delete_volume" :: held 1.786s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:08 devstack sudo[98268]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe 1073741824" returned: 0 in 0.957s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Created reservations ['4535fe4d-f63b-4bb4-bd02-d38693f3a6e9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:08 devstack cinder-volume[86769]: WARNING cinder.quota [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-843129479 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-843129479, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:21:08 devstack cinder-volume[86769]: WARNING cinder.quota [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-843129479 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-843129479, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:21:08 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:08 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Created reservations ['d851c647-2a5a-42d7-89b8-4cf53b700c21', 'b1b73670-bd4a-469e-9984-86d8b146cdc7', '0bb3541b-880f-4e6f-be94-36acca17cbda', '1ebc6fa8-fd18-477b-843b-c6675f3c781e'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:08 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:08 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:09 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:09 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 0.941s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.312s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c76c7450-c95a-4ccf-8591-f1d00e75a5c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='240a79bce6df49be8d73ff7e227c2bb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:02Z,use_quota=True,user_id='5e8597ba114c44a298724e280aa136bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(41087a94-641f-4e0f-81ff-78845b5ccacd),volume_type_id=41087a94-641f-4e0f-81ff-78845b5ccacd)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Creating volume c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:09 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-aba9b46b-a019-4750-b33f-75f08d33738d tempest-GroupsTest-1813426629 None] Delete group completed successfully. Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c233774e-6c59-44be-a94b-2042ea0d5f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5864ec25-3aa0-4324-a75e-986ef6deecbe', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:09 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 1073741824 Jul 07 09:21:09 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb825a2-5504-4069-a0d0-53c8cf9dbed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:09 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Volume volume-5864ec25-3aa0-4324-a75e-986ef6deecbe (5864ec25-3aa0-4324-a75e-986ef6deecbe): created successfully Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ceb825a2-5504-4069-a0d0-53c8cf9dbed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Flow 'volume_create_manager' (67f684a0-d098-4769-89d8-6baabba3bbd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e53d5f80-f289-4861-bf1b-590a22587bcd tempest-VolumesDeleteCascade-2048462040 None] Created volume successfully. Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Created reservations ['8a2fabc0-89c3-4275-b7f8-2435a2a0778f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:09 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:09 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:10 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 1073741824" returned: 0 in 1.032s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:10 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:10 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d081c0af-325a-4ead-88ac-4bd5e234aedb tempest-GroupsTest-1813426629 None] Delete group completed successfully. Jul 07 09:21:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:10 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:10 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ef4e07bd-d044-491f-9b87-ca000c584006 tempest-GroupsTest-1813426629 None] Group tempest-GroupsTest-Group-309022499: creating Jul 07 09:21:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ef4e07bd-d044-491f-9b87-ca000c584006 tempest-GroupsTest-1813426629 None] Group tempest-GroupsTest-Group-309022499: created successfully Jul 07 09:21:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ef4e07bd-d044-491f-9b87-ca000c584006 tempest-GroupsTest-1813426629 None] Create group completed successfully. Jul 07 09:21:11 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.977s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.629s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Creating offline snapshot 04f09431-e76f-47b9-9826-7f4e8bddc304 of volume 5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Attempting download of a452109d-7672-4053-bbf4-d72754d70456 ((None, [{'url': 'file:///opt/stack/data/glance/images/a452109d-7672-4053-bbf4-d72754d70456', 'metadata': {}}])) to volume c76c7450-c95a-4ccf-8591-f1d00e75a5c6. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3d5f01-dc79-4c15-8cd7-49b949e6778e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c8080b-93af-4bf1-b964-9416d0c684e1]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:11 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:11 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:11 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5 Jul 07 09:21:11 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:12 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 0.901s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:12 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5" returned: 0 in 0.875s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:12 devstack sudo[98310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 1G Jul 07 09:21:12 devstack sudo[98310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:12 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5 Jul 07 09:21:12 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Flow 'volume_create_manager' (deefdc41-771a-416c-8a87-58fd83c1aab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614451cb-4647-4ab9-8de4-3331c4369e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (614451cb-4647-4ab9-8de4-3331c4369e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418211969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e2f99a7-0a07-4192-83e9-a6d04c0b1b00,host='devstack@QuobyteHD#QuobyteHD',id=50d057ea-ae4e-42a5-be02-3c0eec94580c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ec864a6fd4c08b59eb2e2ca46237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:13Z,use_quota=True,user_id='b1f4590ac3e54097a94c3a234588d35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6819265f-6188-45f3-b976-fa6ce74bddb2),volume_type_id=6819265f-6188-45f3-b976-fa6ce74bddb2)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b32451-1f8c-4cb7-b6f3-c8614012f1d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b32451-1f8c-4cb7-b6f3-c8614012f1d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2e82a7-20c1-442f-b9fd-a510994f79f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2e82a7-20c1-442f-b9fd-a510994f79f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50d057ea-ae4e-42a5-be02-3c0eec94580c', 'volume_name': 'volume-50d057ea-ae4e-42a5-be02-3c0eec94580c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a77d3f-5a0c-418f-a5ac-d949ea1448ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a77d3f-5a0c-418f-a5ac-d949ea1448ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdbad96-e442-4c90-b07a-5dd02a19a4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Volume 50d057ea-ae4e-42a5-be02-3c0eec94580c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50d057ea-ae4e-42a5-be02-3c0eec94580c', 'volume_size': 1} Jul 07 09:21:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:13 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5" returned: 1 in 1.020s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a452109d-7672-4053-bbf4-d72754d70456_0_k2hsb5' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:21:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb399d3-55d8-4666-8827-01c0b08aada1]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:13 devstack sudo[98310]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 1G" returned: 0 in 1.088s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:13 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:13 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:13 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD Jul 07 09:21:13 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:14 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:14 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 0.791s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:14 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 is being set with open permissions: ugo+rw Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD" returned: 0 in 0.843s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:14 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:14 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:14 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD Jul 07 09:21:14 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:14 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:14 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info Jul 07 09:21:14 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:14 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD" returned: 1 in 0.753s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] a452109d-7672-4053-bbf4-d72754d70456 was raw, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:21:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:14 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:14 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:15 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:15 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info is being set with open permissions: ugo+rw Jul 07 09:21:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:15 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info Jul 07 09:21:15 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:15 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 0 in 0.889s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:15 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a452109d-7672-4053-bbf4-d72754d70456_va6i1d84devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:21:15 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 09:21:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:15 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 1G Jul 07 09:21:15 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:16 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.info" returned: 0 in 0.835s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.139s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.458s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e2f99a7-0a07-4192-83e9-a6d04c0b1b00,created_at=2026-07-07T07:21:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-418211969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e2f99a7-0a07-4192-83e9-a6d04c0b1b00,host='devstack@QuobyteHD#QuobyteHD',id=50d057ea-ae4e-42a5-be02-3c0eec94580c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ec864a6fd4c08b59eb2e2ca46237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:13Z,use_quota=True,user_id='b1f4590ac3e54097a94c3a234588d35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6819265f-6188-45f3-b976-fa6ce74bddb2),volume_type_id=6819265f-6188-45f3-b976-fa6ce74bddb2)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Creating volume 50d057ea-ae4e-42a5-be02-3c0eec94580c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:16 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:16 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c 1073741824 Jul 07 09:21:16 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-74d39f9c-5329-4c98-87e6-921d433ff524 tempest-VolumesDeleteCascade-2048462040 None] Create snapshot completed successfully Jul 07 09:21:16 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 1G" returned: 0 in 0.864s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[451b72f8-572b-4cc9-a7fc-89c16b9f2077]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:16 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:16 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:17 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c 1073741824" returned: 0 in 1.108s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:17 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 0 in 0.958s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:17 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c Jul 07 09:21:17 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:17 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:17 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:18 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c" returned: 0 in 0.960s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.146s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.337s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bdbad96-e442-4c90-b07a-5dd02a19a4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50d057ea-ae4e-42a5-be02-3c0eec94580c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba78c0c2-e8d4-45fc-9888-de21171151f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:18 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Creating offline snapshot 121bcaf0-e551-4fa3-88cb-6704e5a90686 of volume 5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 1 in 1.010s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Downloaded image a452109d-7672-4053-bbf4-d72754d70456 ((None, [{'url': 'file:///opt/stack/data/glance/images/a452109d-7672-4053-bbf4-d72754d70456', 'metadata': {}}])) to volume c76c7450-c95a-4ccf-8591-f1d00e75a5c6 successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Temporary image a452109d-7672-4053-bbf4-d72754d70456 for user 5e8597ba114c44a298724e280aa136bb is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Marking volume c76c7450-c95a-4ccf-8591-f1d00e75a5c6 as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:21:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Volume volume-50d057ea-ae4e-42a5-be02-3c0eec94580c (50d057ea-ae4e-42a5-be02-3c0eec94580c): created successfully Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba78c0c2-e8d4-45fc-9888-de21171151f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Flow 'volume_create_manager' (deefdc41-771a-416c-8a87-58fd83c1aab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8a5a80-fe59-41d7-a569-b01f3596fd54]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-296de8f8-8180-4a65-9984-524095deea85 tempest-GroupsTest-1813426629 None] Created volume successfully. Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Copying metadata from image a452109d-7672-4053-bbf4-d72754d70456 to c76c7450-c95a-4ccf-8591-f1d00e75a5c6. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Creating volume glance metadata for volume c76c7450-c95a-4ccf-8591-f1d00e75a5c6 backed by image a452109d-7672-4053-bbf4-d72754d70456 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a452109d-7672-4053-bbf4-d72754d70456', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e7cb9966a8dfea123f86f695e1095999', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a712862-bafd-487c-b236-e82f70fa4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6', 'volume_size': 1, 'image_id': 'a452109d-7672-4053-bbf4-d72754d70456', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a452109d-7672-4053-bbf4-d72754d70456', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e7cb9966a8dfea123f86f695e1095999', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '240a79bce6df49be8d73ff7e227c2bb1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ce4b61cf636bffd8040066fffc7c9e5d666ae8d23a7001f82800541a9f8f6fdaded5be250b2310839e226b2e42c9cddb6063fe135cd00b0b38a55d57ebfeb6be', 'id': 'a452109d-7672-4053-bbf4-d72754d70456', 'created_at': datetime.datetime(2026, 7, 7, 7, 20, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 21, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a452109d-7672-4053-bbf4-d72754d70456/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff63d93-adb0-4d8d-b001-e5d73b52b321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:18 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:18 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Volume volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 (c76c7450-c95a-4ccf-8591-f1d00e75a5c6): created successfully Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff63d93-adb0-4d8d-b001-e5d73b52b321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Flow 'volume_create_manager' (3e13b931-3279-42ee-99d6-ef7e95c1d942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e873aaa6-b253-4836-a0ee-d53d635a56f9 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Created volume successfully. Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Flow 'volume_create_manager' (4daece02-a265-47c7-8a97-27728e769aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e5db3d-7480-4bd9-96a2-1b65c96ad441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Acquiring lock "cinder-c76c7450-c95a-4ccf-8591-f1d00e75a5c6-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e5db3d-7480-4bd9-96a2-1b65c96ad441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498077712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e2f99a7-0a07-4192-83e9-a6d04c0b1b00,host='devstack@QuobyteHD#QuobyteHD',id=f527eeda-5a70-4b3d-bae7-baedd6af716e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ec864a6fd4c08b59eb2e2ca46237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:19Z,use_quota=True,user_id='b1f4590ac3e54097a94c3a234588d35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6819265f-6188-45f3-b976-fa6ce74bddb2),volume_type_id=6819265f-6188-45f3-b976-fa6ce74bddb2)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc3b3c2-0774-4ebc-9f10-7d32aeb750f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bc3b3c2-0774-4ebc-9f10-7d32aeb750f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591db94d-a071-459f-87cb-e6bdfcfde009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591db94d-a071-459f-87cb-e6bdfcfde009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f527eeda-5a70-4b3d-bae7-baedd6af716e', 'volume_name': 'volume-f527eeda-5a70-4b3d-bae7-baedd6af716e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae463d-1768-45b0-b537-0f2e99f9d7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae463d-1768-45b0-b537-0f2e99f9d7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e69cb2-1459-4fc6-aba3-0bf1a3e8e218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Volume f527eeda-5a70-4b3d-bae7-baedd6af716e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f527eeda-5a70-4b3d-bae7-baedd6af716e', 'volume_size': 1} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "cinder-c76c7450-c95a-4ccf-8591-f1d00e75a5c6-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Acquiring lock "cinder-quobyte-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "cinder-quobyte-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:19 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 1.151s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5864ec25-3aa0-4324-a75e-986ef6deecbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[100d1d7d-638f-4550-b758-2bae046be582]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:19 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 1G Jul 07 09:21:19 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:19 devstack sudo[98379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:19 devstack sudo[98379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:20 devstack sudo[98379]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 0 in 0.836s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:20 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 1G" returned: 0 in 0.946s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:20 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 Jul 07 09:21:20 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:20 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:20 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:21 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 1 in 0.955s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:21:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:21 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686" returned: 0 in 0.894s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:21 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 is being set with open permissions: ugo+rw Jul 07 09:21:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:21 devstack sudo[98398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6 Jul 07 09:21:21 devstack sudo[98398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:21 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 Jul 07 09:21:21 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Flow 'volume_create_manager' (eb613088-6846-4da8-8f07-21abcea35fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e03f0a1-38fe-43b9-a300-b3cfe5c2462b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e03f0a1-38fe-43b9-a300-b3cfe5c2462b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1482302963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428642ef-061d-4277-970d-de714024ab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a78147f8ecf4a6397242c50d08eef62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:22Z,use_quota=True,user_id='fc4eefc3665f42178b5e39224e198f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f3b944-3e0b-4737-bed9-87f7068ab23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59f3b944-3e0b-4737-bed9-87f7068ab23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc30407-d750-4a28-80a9-dfa71d54ba17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc30407-d750-4a28-80a9-dfa71d54ba17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428642ef-061d-4277-970d-de714024ab10', 'volume_name': 'volume-428642ef-061d-4277-970d-de714024ab10', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a94ff60-fad7-4bf8-8a77-4403dfbb2fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a94ff60-fad7-4bf8-8a77-4403dfbb2fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd867733-a216-4a36-b0ac-8a8068990587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Volume 428642ef-061d-4277-970d-de714024ab10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428642ef-061d-4277-970d-de714024ab10', 'volume_size': 1} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:22 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686" returned: 0 in 0.743s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.890s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.692s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3e2f99a7-0a07-4192-83e9-a6d04c0b1b00,created_at=2026-07-07T07:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1498077712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3e2f99a7-0a07-4192-83e9-a6d04c0b1b00,host='devstack@QuobyteHD#QuobyteHD',id=f527eeda-5a70-4b3d-bae7-baedd6af716e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b6ec864a6fd4c08b59eb2e2ca46237f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:19Z,use_quota=True,user_id='b1f4590ac3e54097a94c3a234588d35c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6819265f-6188-45f3-b976-fa6ce74bddb2),volume_type_id=6819265f-6188-45f3-b976-fa6ce74bddb2)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Creating volume f527eeda-5a70-4b3d-bae7-baedd6af716e {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:22 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:22 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e 1073741824 Jul 07 09:21:22 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fe996e1f-3fe9-4541-b28f-4f188ac27587 tempest-VolumesDeleteCascade-2048462040 None] Create snapshot completed successfully Jul 07 09:21:22 devstack sudo[98398]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" returned: 0 in 0.895s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "cinder-quobyte-c76c7450-c95a-4ccf-8591-f1d00e75a5c6" released by "delete_volume" :: held 2.760s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Flow 'volume_create_manager' (bf59ac07-baab-4fd0-9753-12ce00398305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a226db-509d-4659-9dcb-8a7b5eb212f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: WARNING cinder.quota [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:21:22 devstack cinder-volume[86769]: WARNING cinder.quota [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2a226db-509d-4659-9dcb-8a7b5eb212f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1990666605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e40b42-5f4d-409f-b63f-5c56ad1be9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a78147f8ecf4a6397242c50d08eef62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:22Z,use_quota=True,user_id='fc4eefc3665f42178b5e39224e198f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde1218c-45ad-45b9-93f2-6ee340b659e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cde1218c-45ad-45b9-93f2-6ee340b659e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356ab587-e07c-43fb-bfa6-94db88ebae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (356ab587-e07c-43fb-bfa6-94db88ebae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30e40b42-5f4d-409f-b63f-5c56ad1be9c4', 'volume_name': 'volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5492d5d8-0cdf-44f0-90ba-de05ef974492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5492d5d8-0cdf-44f0-90ba-de05ef974492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b305e4fb-8833-4ff7-b950-02880ca61664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:22 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Volume 30e40b42-5f4d-409f-b63f-5c56ad1be9c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4', 'volume_size': 1} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Created reservations ['9f61ca24-d383-4c53-a54b-8a3df5d322d9', '9694dac3-8776-47d8-9c4f-dde63b01f761', 'a39493ca-ef72-4fd8-af96-72da7f7ae9d7', 'e7bcb47a-c054-4edd-b1bf-4cc2839ee109'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:22 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:22 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-5864ec25-3aa0-4324-a75e-986ef6deecbe-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:23 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-5864ec25-3aa0-4324-a75e-986ef6deecbe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.813s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:23 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Deleted volume successfully. Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e 1073741824" returned: 0 in 1.189s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac7c802a-4fdf-45ed-b07c-6cf36fb0c7e7 tempest-VolumeAndVolumeTypeFromImageTest-1428790907 None] Lock "cinder-c76c7450-c95a-4ccf-8591-f1d00e75a5c6-delete_volume" released by "delete_volume" :: held 3.999s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Performing cascade delete. {{(pid=86769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-04f09431-e76f-47b9-9826-7f4e8bddc304-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-04f09431-e76f-47b9-9826-7f4e8bddc304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:23 devstack sudo[98413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e Jul 07 09:21:23 devstack sudo[98413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-04f09431-e76f-47b9-9826-7f4e8bddc304" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-04f09431-e76f-47b9-9826-7f4e8bddc304" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Deleting offline snapshot 04f09431-e76f-47b9-9826-7f4e8bddc304 of volume 5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] snapshot_file for this snap is: volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae79667-9c25-4e15-b181-d5f4d1a86df4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:23 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:23 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:24 devstack sudo[98413]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e" returned: 0 in 0.811s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] <== create_volume: return (2183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.310s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1482302963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428642ef-061d-4277-970d-de714024ab10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a78147f8ecf4a6397242c50d08eef62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:22Z,use_quota=True,user_id='fc4eefc3665f42178b5e39224e198f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Creating volume 428642ef-061d-4277-970d-de714024ab10 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:24 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02e69cb2-1459-4fc6-aba3-0bf1a3e8e218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f527eeda-5a70-4b3d-bae7-baedd6af716e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:24 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 1073741824 Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48b2836-117f-44e4-86e5-c027bb201c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:24 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:24 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Volume volume-f527eeda-5a70-4b3d-bae7-baedd6af716e (f527eeda-5a70-4b3d-bae7-baedd6af716e): created successfully Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48b2836-117f-44e4-86e5-c027bb201c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Flow 'volume_create_manager' (4daece02-a265-47c7-8a97-27728e769aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=110,cinder:INSERT=29,cinder:SELECT=97,cinder:DELETE=9 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:21:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-46ed6089-7348-49e3-9bcc-0140ef2d8ad2 tempest-GroupsTest-1813426629 None] Created volume successfully. Jul 07 09:21:24 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 0.930s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5864ec25-3aa0-4324-a75e-986ef6deecbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8e66ae-0330-442c-aad5-fbd1b19d642a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:24 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:24 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:25 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 1073741824" returned: 0 in 1.159s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:25 devstack sudo[98433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 Jul 07 09:21:25 devstack sudo[98433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:25 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 1.067s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b38d935-c974-4b63-a12a-5c51d831acb1]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5c0d21bc-e2d1-4374-9f0a-efba3581c2fc tempest-GroupsTest-1813426629 None] Update group completed successfully. Jul 07 09:21:26 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 Jul 07 09:21:26 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:26 devstack sudo[98433]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10" returned: 0 in 1.123s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] <== create_volume: return (2336ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.342s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.256s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1990666605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30e40b42-5f4d-409f-b63f-5c56ad1be9c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4a78147f8ecf4a6397242c50d08eef62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:22Z,use_quota=True,user_id='fc4eefc3665f42178b5e39224e198f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Creating volume 30e40b42-5f4d-409f-b63f-5c56ad1be9c4 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:26 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:26 devstack sudo[98443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 1073741824 Jul 07 09:21:26 devstack sudo[98443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:27 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:27 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd867733-a216-4a36-b0ac-8a8068990587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428642ef-061d-4277-970d-de714024ab10', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8096b92f-8e0f-4b86-9b28-951e0c444306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:27 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Volume volume-428642ef-061d-4277-970d-de714024ab10 (428642ef-061d-4277-970d-de714024ab10): created successfully Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8096b92f-8e0f-4b86-9b28-951e0c444306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Flow 'volume_create_manager' (eb613088-6846-4da8-8f07-21abcea35fbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5cdf100f-4288-441d-aa49-af10072b57af tempest-TestServerVolumeAttachmentScenario-1210504325 None] Created volume successfully. Jul 07 09:21:27 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686" returned: 0 in 1.331s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5864ec25-3aa0-4324-a75e-986ef6deecbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128d0de-c860-46cd-91f2-d531b98b450d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:27 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:27 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8a042d74-840d-42d1-a378-724eef31f9fc tempest-GroupsTest-1813426629 None] Update group completed successfully. Jul 07 09:21:28 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.211s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:21:28 devstack sudo[98443]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 1073741824" returned: 0 in 1.408s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:28 devstack sudo[98459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 Jul 07 09:21:28 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:28 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 1.133s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5864ec25-3aa0-4324-a75e-986ef6deecbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5becc4d0-4753-4114-b1ae-0d4785e71051]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:28 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:28 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:29 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" returned: 0 in 0.840s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] <== create_volume: return (2307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.312s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b305e4fb-8833-4ff7-b950-02880ca61664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746587e1-5c63-45e8-a0ba-c8fd61b16f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:29 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Volume volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 (30e40b42-5f4d-409f-b63f-5c56ad1be9c4): created successfully Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (746587e1-5c63-45e8-a0ba-c8fd61b16f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Flow 'volume_create_manager' (bf59ac07-baab-4fd0-9753-12ce00398305) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4d152bf7-2b54-4c98-88d7-198363e45345 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Created volume successfully. Jul 07 09:21:29 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 0.905s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:29 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:29 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Acquiring lock "cinder-quobyte-50d057ea-ae4e-42a5-be02-3c0eec94580c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Lock "cinder-quobyte-50d057ea-ae4e-42a5-be02-3c0eec94580c" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fa0104-8975-453b-831e-13b9850a40ee]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:29 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c Jul 07 09:21:29 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (34af82b8-9400-439f-95e0-0a8d405bc46e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7310db-77bb-46e5-b2a1-08eb1995a00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7310db-77bb-46e5-b2a1-08eb1995a00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1418808084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:30Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ab0c43-fd1f-4ff3-8a7b-7a4453b8d3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10ab0c43-fd1f-4ff3-8a7b-7a4453b8d3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8c6ede-e98a-4968-a43a-0198515c85ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8c6ede-e98a-4968-a43a-0198515c85ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc', 'volume_name': 'volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed3c18d-8fff-447b-ac74-c7489f3dd75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ed3c18d-8fff-447b-ac74-c7489f3dd75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cb278b-4575-4cd7-be25-d25af55da0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Volume accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc', 'volume_size': 1} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1418808084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:30Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Creating volume accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:30 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:30 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc 1073741824 Jul 07 09:21:30 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:30 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 0.998s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:30 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304 Jul 07 09:21:30 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (735771e2-8c7b-46c6-a9bc-10e85b31ddda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4da5a3c-202a-4be4-82d2-9188522233bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4da5a3c-202a-4be4-82d2-9188522233bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147541216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e985bb70-c809-42dc-8a0c-5b3a9e4a581c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:30Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79861843-ffa3-43ff-bacf-0e77d1ce8888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79861843-ffa3-43ff-bacf-0e77d1ce8888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1546718d-fbc0-4ec6-a495-ba7d16427ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1546718d-fbc0-4ec6-a495-ba7d16427ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e985bb70-c809-42dc-8a0c-5b3a9e4a581c', 'volume_name': 'volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e5ec90-f968-48a1-85d8-a6dae95fe439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3e5ec90-f968-48a1-85d8-a6dae95fe439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6d5b6b-276c-47f3-a161-5982de3cd379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:30 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Volume e985bb70-c809-42dc-8a0c-5b3a9e4a581c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c', 'volume_size': 1} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:30 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c" returned: 0 in 1.167s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:30 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c Jul 07 09:21:30 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (d35bb01f-d8bb-4413-a91c-688e4100ab88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c0e343-6fc0-4a6b-ba9d-0774774e27f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04c0e343-6fc0-4a6b-ba9d-0774774e27f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014668890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ea567e-354f-4d7e-954d-63045471f14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:31Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3530841-a150-4cf4-906d-469284f1820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3530841-a150-4cf4-906d-469284f1820f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1485d7-e392-4555-8c3e-ab9e25e6093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f1485d7-e392-4555-8c3e-ab9e25e6093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ea567e-354f-4d7e-954d-63045471f14d', 'volume_name': 'volume-a5ea567e-354f-4d7e-954d-63045471f14d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7987d3c2-f260-4bc8-bd4d-ba4315f1c8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7987d3c2-f260-4bc8-bd4d-ba4315f1c8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491a2be8-dc5b-438f-976b-b27df02d1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Volume a5ea567e-354f-4d7e-954d-63045471f14d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ea567e-354f-4d7e-954d-63045471f14d', 'volume_size': 1} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:31 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.04f09431-e76f-47b9-9826-7f4e8bddc304" returned: 0 in 1.021s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 -F qcow2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:31 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 -F qcow2 Jul 07 09:21:31 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (c97c3aae-f927-4a67-8d67-8b5ebf85e62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10233cca-b3f2-4406-a408-471aacc64f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10233cca-b3f2-4406-a408-471aacc64f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497402868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79574aed-36f6-4b4c-b530-45eff7d29bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:32Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fcef8b-1ee5-4b2a-a806-157c84fa0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75fcef8b-1ee5-4b2a-a806-157c84fa0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724a47de-3610-4e55-a2e8-4d6309e65252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724a47de-3610-4e55-a2e8-4d6309e65252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79574aed-36f6-4b4c-b530-45eff7d29bee', 'volume_name': 'volume-79574aed-36f6-4b4c-b530-45eff7d29bee', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1046d7fd-1d07-41a2-918f-e745cfa6de91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1046d7fd-1d07-41a2-918f-e745cfa6de91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878d0c34-64f7-41a7-98df-1075de3f0749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:31 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Volume 79574aed-36f6-4b4c-b530-45eff7d29bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79574aed-36f6-4b4c-b530-45eff7d29bee', 'volume_size': 1} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:31 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc 1073741824" returned: 0 in 1.503s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:31 devstack sudo[98493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc Jul 07 09:21:31 devstack sudo[98493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:31 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-50d057ea-ae4e-42a5-be02-3c0eec94580c" returned: 0 in 1.192s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Lock "cinder-quobyte-50d057ea-ae4e-42a5-be02-3c0eec94580c" released by "delete_volume" :: held 2.440s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Acquiring lock "cinder-quobyte-f527eeda-5a70-4b3d-bae7-baedd6af716e" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Lock "cinder-quobyte-f527eeda-5a70-4b3d-bae7-baedd6af716e" acquired by "delete_volume" :: waited 0.048s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ac7566-befb-46b9-bab5-138b64bcabfc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (9bd34bbf-107d-4775-be2d-9f46d1f232b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992103aa-186e-4e1d-899e-67ff6f220c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (992103aa-186e-4e1d-899e-67ff6f220c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436290122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb0fb20-f762-42a0-a934-d48e7855280e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:32Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef5f68c-65ea-40d7-b62c-353e203ecd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef5f68c-65ea-40d7-b62c-353e203ecd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50931d08-306c-4f1e-87cc-97f7ba2c6223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50931d08-306c-4f1e-87cc-97f7ba2c6223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeb0fb20-f762-42a0-a934-d48e7855280e', 'volume_name': 'volume-eeb0fb20-f762-42a0-a934-d48e7855280e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:32 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e Jul 07 09:21:32 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cb07c4-dca5-4925-93b1-d69baecc703d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97cb07c4-dca5-4925-93b1-d69baecc703d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da2a3b3-8d6d-476d-b6bd-5cc0fb535f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:32 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Volume eeb0fb20-f762-42a0-a934-d48e7855280e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeb0fb20-f762-42a0-a934-d48e7855280e', 'volume_size': 1} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:32 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5864ec25-3aa0-4324-a75e-986ef6deecbe /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 -F qcow2" returned: 0 in 1.063s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-04f09431-e76f-47b9-9826-7f4e8bddc304" released by "_delete_snapshot" :: held 8.697s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" released by "delete_snapshot" :: held 8.730s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Created reservations ['e2d203c2-d85c-4d8f-b7cc-c111e43d4dd9', '0f25335e-cdaa-4f6b-8812-607bb99940ca', '28d971ac-69b6-4d5f-972e-aa8062081176', '2d116bfb-6d27-4f32-84a2-7842a9fccb75'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Delete snapshot completed successfully. Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-04f09431-e76f-47b9-9826-7f4e8bddc304-delete_snapshot" released by "delete_snapshot" :: held 8.994s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-121bcaf0-e551-4fa3-88cb-6704e5a90686-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-121bcaf0-e551-4fa3-88cb-6704e5a90686-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-121bcaf0-e551-4fa3-88cb-6704e5a90686" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-121bcaf0-e551-4fa3-88cb-6704e5a90686" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Deleting offline snapshot 121bcaf0-e551-4fa3-88cb-6704e5a90686 of volume 5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] snapshot_file for this snap is: volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd48a8f-3344-4f93-9157-0138f7329e66]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:32 devstack sudo[98493]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc" returned: 0 in 1.174s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] <== create_volume: return (2733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.736s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-147541216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e985bb70-c809-42dc-8a0c-5b3a9e4a581c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:30Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Creating volume e985bb70-c809-42dc-8a0c-5b3a9e4a581c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:33 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:33 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c 1073741824 Jul 07 09:21:33 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:33 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 Jul 07 09:21:33 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88cb278b-4575-4cd7-be25-d25af55da0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fc6917-2a43-4148-b3f8-a3f2de7f1905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:33 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Volume volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc (accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc): created successfully Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28fc6917-2a43-4148-b3f8-a3f2de7f1905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (34af82b8-9400-439f-95e0-0a8d405bc46e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1841d491-fc42-421e-8da7-285948c2f07b tempest-CreateVolumesFromImageTest-1360312367 None] Created volume successfully. Jul 07 09:21:33 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e" returned: 0 in 1.300s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:33 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e Jul 07 09:21:33 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:34 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686" returned: 0 in 1.304s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5864ec25-3aa0-4324-a75e-986ef6deecbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[898e0697-be84-45ad-9e98-797396d77756]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:34 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c 1073741824" returned: 0 in 1.263s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:34 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f527eeda-5a70-4b3d-bae7-baedd6af716e" returned: 0 in 0.938s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Lock "cinder-quobyte-f527eeda-5a70-4b3d-bae7-baedd6af716e" released by "delete_volume" :: held 2.340s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:34 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:34 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:34 devstack sudo[98533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c Jul 07 09:21:34 devstack sudo[98533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Created reservations ['03cd9da1-e2bb-40a5-bd8c-f051eb5fe5d8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:34 devstack cinder-volume[86769]: WARNING cinder.quota [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1252251695 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1252251695, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:21:34 devstack cinder-volume[86769]: WARNING cinder.quota [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1252251695 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1252251695, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Created reservations ['2c9ee5f7-1bc6-4bee-a97e-e361bea82e61', '60b527f0-4090-44d1-8b44-9ed28f14c1e5', '8693a393-656c-4195-a365-9400c08ed571', 'b51413bd-e016-49f1-ac09-3fc38c02122c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Created reservations ['6a215359-db11-4f30-8e17-56699fd026aa', '1d1e76f1-072f-4c37-b472-b70aeea6b6b0', '74bbe3ea-870c-4dad-ac14-4cd1c389f14d', '0ebe6243-2f1a-45be-94e7-dee6ed26e672'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:35 devstack sudo[98540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:35 devstack sudo[98540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:35 devstack sudo[98533]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c" returned: 0 in 0.875s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.273s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.048s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2014668890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ea567e-354f-4d7e-954d-63045471f14d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:31Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Creating volume a5ea567e-354f-4d7e-954d-63045471f14d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:35 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:35 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d 1073741824 Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e6d5b6b-276c-47f3-a161-5982de3cd379) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:35 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973e8f7f-2b93-492a-bc1c-87eb7664bcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Volume volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c (e985bb70-c809-42dc-8a0c-5b3a9e4a581c): created successfully Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973e8f7f-2b93-492a-bc1c-87eb7664bcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (735771e2-8c7b-46c6-a9bc-10e85b31ddda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c9e21b2c-2399-40ee-a514-df4ef10892db tempest-CreateVolumesFromImageTest-1360312367 None] Created volume successfully. Jul 07 09:21:35 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 1.240s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:35 devstack sudo[98549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 Jul 07 09:21:35 devstack sudo[98549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:35 devstack sudo[98540]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.877s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:35 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-032a0049-1b17-48b6-8aac-15c631e48dc8 tempest-GroupsTest-1813426629 None] Delete group completed successfully. Jul 07 09:21:36 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d 1073741824" returned: 0 in 0.989s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:36 devstack sudo[98549]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686" returned: 0 in 0.870s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:36 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686 Jul 07 09:21:36 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:36 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d Jul 07 09:21:36 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:37 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:37 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe.121bcaf0-e551-4fa3-88cb-6704e5a90686" returned: 0 in 0.836s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d" returned: 0 in 0.831s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] <== create_volume: return (1886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.890s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.498s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1497402868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79574aed-36f6-4b4c-b530-45eff7d29bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:32Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Creating volume 79574aed-36f6-4b4c-b530-45eff7d29bee {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:37 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-121bcaf0-e551-4fa3-88cb-6704e5a90686" released by "_delete_snapshot" :: held 4.398s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" released by "delete_snapshot" :: held 4.440s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:37 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee 1073741824 Jul 07 09:21:37 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491a2be8-dc5b-438f-976b-b27df02d1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ea567e-354f-4d7e-954d-63045471f14d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0a7ee6-8520-4714-b2e8-eeee1036e7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Volume volume-a5ea567e-354f-4d7e-954d-63045471f14d (a5ea567e-354f-4d7e-954d-63045471f14d): created successfully Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0a7ee6-8520-4714-b2e8-eeee1036e7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (d35bb01f-d8bb-4413-a91c-688e4100ab88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-714c628d-dddd-4691-8841-bf0e7920a031 tempest-CreateVolumesFromImageTest-1360312367 None] Created volume successfully. Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Created reservations ['40d65de2-1af7-4700-94d8-a8a1f352fd96', '1d5f4ad1-9b1c-4f1c-9d05-054e09b52781', 'dae32873-ae0d-4a2d-af56-0d2d0acfd78b', '2d450492-132a-4fc6-a9be-a095d59fe00a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Delete snapshot completed successfully. Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-121bcaf0-e551-4fa3-88cb-6704e5a90686-delete_snapshot" released by "delete_snapshot" :: held 4.783s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Snapshots deleted, issuing volume delete {{(pid=86769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a2c199-d0cd-444d-a812-2abd71853eb9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:37 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:37 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:38 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee 1073741824" returned: 0 in 1.213s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:38 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee Jul 07 09:21:38 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:38 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 1.007s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:38 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe Jul 07 09:21:38 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:39 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee" returned: 0 in 0.904s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.169s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.068s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1436290122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeb0fb20-f762-42a0-a934-d48e7855280e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b80d97d74924fd3bae91a08d28d6d2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:32Z,use_quota=True,user_id='56a611e5f2b8431994ac939bd338c723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Creating volume eeb0fb20-f762-42a0-a934-d48e7855280e {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:39 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878d0c34-64f7-41a7-98df-1075de3f0749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79574aed-36f6-4b4c-b530-45eff7d29bee', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2a2cf6-b4f1-46d7-abf7-d7b7c7379381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:39 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e 1073741824 Jul 07 09:21:39 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:39 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Volume volume-79574aed-36f6-4b4c-b530-45eff7d29bee (79574aed-36f6-4b4c-b530-45eff7d29bee): created successfully Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de2a2cf6-b4f1-46d7-abf7-d7b7c7379381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (c97c3aae-f927-4a67-8d67-8b5ebf85e62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3f812c68-dc64-4694-bbb7-68099908df43 tempest-CreateVolumesFromImageTest-1360312367 None] Created volume successfully. Jul 07 09:21:39 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5864ec25-3aa0-4324-a75e-986ef6deecbe" returned: 0 in 1.207s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-5864ec25-3aa0-4324-a75e-986ef6deecbe" released by "delete_volume" :: held 2.313s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Created reservations ['8d59004f-969a-4054-888f-e7d8eda1066f', '04d564a9-4fc7-4c7c-8889-374a1b51bcdc', '10ad00fb-dc1e-4824-8616-e146f3caa393', '5e82608b-45f7-4635-b7dc-56c7f78ca812'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:40 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:40 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:40 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e 1073741824" returned: 0 in 1.298s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:40 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e Jul 07 09:21:40 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Flow 'volume_create_manager' (5d535798-0448-4bef-82b4-ac8a72876dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a6bbb3-6b87-40f3-85e7-d13e0093c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:41 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65a6bbb3-6b87-40f3-85e7-d13e0093c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-221672540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10796112-838f-41c8-af8a-2f19be085c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e8c39c22cd4e71b489dacd90b062be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:41Z,use_quota=True,user_id='f9e3b497820b43e9bc32d5de6e879e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958ce33b-dc65-40f7-91b8-1bfa54113b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (958ce33b-dc65-40f7-91b8-1bfa54113b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5b258-5e9b-424d-9813-35af65db0b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dc5b258-5e9b-424d-9813-35af65db0b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10796112-838f-41c8-af8a-2f19be085c13', 'volume_name': 'volume-10796112-838f-41c8-af8a-2f19be085c13', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8822c77a-eaad-45a8-91c0-a29ab8f04cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8822c77a-eaad-45a8-91c0-a29ab8f04cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4eeba0-45ba-4b55-9018-793d0158f570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Volume 10796112-838f-41c8-af8a-2f19be085c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10796112-838f-41c8-af8a-2f19be085c13', 'volume_size': 1} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.215s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Deleted volume successfully. Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e65ce0a7-32e6-4e2e-b641-9e80402979a5 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-5864ec25-3aa0-4324-a75e-986ef6deecbe-delete_volume" released by "delete_volume" :: held 17.856s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:41 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e" returned: 0 in 0.894s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.274s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.259s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-221672540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10796112-838f-41c8-af8a-2f19be085c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e8c39c22cd4e71b489dacd90b062be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:41Z,use_quota=True,user_id='f9e3b497820b43e9bc32d5de6e879e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Creating volume 10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:41 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da2a3b3-8d6d-476d-b6bd-5cc0fb535f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeb0fb20-f762-42a0-a934-d48e7855280e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15944119-9ff6-4bcb-accd-f67c2743d501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:41 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 1073741824 Jul 07 09:21:41 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Volume volume-eeb0fb20-f762-42a0-a934-d48e7855280e (eeb0fb20-f762-42a0-a934-d48e7855280e): created successfully Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15944119-9ff6-4bcb-accd-f67c2743d501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Flow 'volume_create_manager' (9bd34bbf-107d-4775-be2d-9f46d1f232b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-05026715-4746-4de4-8c7a-a85d2199e89c tempest-CreateVolumesFromImageTest-1360312367 None] Created volume successfully. Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-eeb0fb20-f762-42a0-a934-d48e7855280e-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-eeb0fb20-f762-42a0-a934-d48e7855280e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-quobyte-eeb0fb20-f762-42a0-a934-d48e7855280e" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-eeb0fb20-f762-42a0-a934-d48e7855280e" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a00b287-df20-47a3-9bab-107b1097c402]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:42 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e Jul 07 09:21:42 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:42 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 1073741824" returned: 0 in 1.160s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:42 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:21:42 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:43 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 1.021s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.237s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4eeba0-45ba-4b55-9018-793d0158f570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10796112-838f-41c8-af8a-2f19be085c13', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a463bb9d-a968-496f-8cc1-0c08fdc100bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:43 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Volume volume-10796112-838f-41c8-af8a-2f19be085c13 (10796112-838f-41c8-af8a-2f19be085c13): created successfully Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a463bb9d-a968-496f-8cc1-0c08fdc100bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Flow 'volume_create_manager' (5d535798-0448-4bef-82b4-ac8a72876dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-77e5aba0-69d3-4a0d-afcb-0de0d7cb2b39 tempest-VolumesDeleteCascade-2048462040 None] Created volume successfully. Jul 07 09:21:44 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Flow 'volume_create_manager' (4253035b-e4c9-4335-89a5-c23149e8bd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f32db61-5dda-4b25-ac1a-8b37c1c0d5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e" returned: 0 in 1.660s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:44 devstack sudo[98711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e Jul 07 09:21:44 devstack sudo[98711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f32db61-5dda-4b25-ac1a-8b37c1c0d5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-161255090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29698aff-73ba-4ab0-895c-da210732101b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813ae2ca2eb6467588a1532e571e9a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:44Z,use_quota=True,user_id='bb852f2cdcda402f8b9ca115265f5d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f6d51d-69d0-4cb8-a8e3-ecd80c376b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65f6d51d-69d0-4cb8-a8e3-ecd80c376b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9237321b-0192-46c1-b865-0496190ab63e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9237321b-0192-46c1-b865-0496190ab63e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29698aff-73ba-4ab0-895c-da210732101b', 'volume_name': 'volume-29698aff-73ba-4ab0-895c-da210732101b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d712a638-a49f-4e8a-8212-cd0dd61b4a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d712a638-a49f-4e8a-8212-cd0dd61b4a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c4647c-8e21-4d95-8beb-2746fbf2669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:44 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Volume 29698aff-73ba-4ab0-895c-da210732101b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29698aff-73ba-4ab0-895c-da210732101b', 'volume_size': 1} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-161255090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29698aff-73ba-4ab0-895c-da210732101b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='813ae2ca2eb6467588a1532e571e9a40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:44Z,use_quota=True,user_id='bb852f2cdcda402f8b9ca115265f5d68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Creating volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:44 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:44 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b 1073741824 Jul 07 09:21:44 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:45 devstack sudo[98711]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-eeb0fb20-f762-42a0-a934-d48e7855280e" returned: 0 in 1.114s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-eeb0fb20-f762-42a0-a934-d48e7855280e" released by "delete_volume" :: held 2.827s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Created reservations ['d702646f-2007-4947-a510-c0978d20e260', 'aa41a348-be9f-47f6-b4ec-046b4edc5b31', '82b646b8-8b21-4b74-902c-b657a17c75a6', 'd512f756-7422-4f51-9a2c-1d2fa6c733f4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:45 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:45 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:45 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b 1073741824" returned: 0 in 1.302s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:45 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b Jul 07 09:21:45 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-79574aed-36f6-4b4c-b530-45eff7d29bee-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-79574aed-36f6-4b4c-b530-45eff7d29bee-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-quobyte-79574aed-36f6-4b4c-b530-45eff7d29bee" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-79574aed-36f6-4b4c-b530-45eff7d29bee" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[283ad425-1cf0-4424-95cc-9fdb0797b334]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:46 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee Jul 07 09:21:46 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:46 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.903s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Deleted volume successfully. Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32379abc-98c8-4afb-8030-9e98610551e9 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-eeb0fb20-f762-42a0-a934-d48e7855280e-delete_volume" released by "delete_volume" :: held 4.029s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:46 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b" returned: 0 in 0.876s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] <== create_volume: return (2231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.234s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.774s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64c4647c-8e21-4d95-8beb-2746fbf2669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29698aff-73ba-4ab0-895c-da210732101b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af02585-7808-43bd-b565-762ebe841e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Creating offline snapshot bf91f6db-7746-4257-9a74-81173af8236d of volume 10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:21:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Volume volume-29698aff-73ba-4ab0-895c-da210732101b (29698aff-73ba-4ab0-895c-da210732101b): created successfully Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af02585-7808-43bd-b565-762ebe841e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Flow 'volume_create_manager' (4253035b-e4c9-4335-89a5-c23149e8bd5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d68b67-b0ab-4d28-be92-e826e65a69ee]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6d503f12-7fb7-4d2f-bb07-15dbec7f0ff3 tempest-SnapshotsActionsTest-1388511838 None] Created volume successfully. Jul 07 09:21:46 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:21:46 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:47 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee" returned: 0 in 0.991s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:47 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee Jul 07 09:21:47 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:47 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 0.937s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:47 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d 1G Jul 07 09:21:47 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:47 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-79574aed-36f6-4b4c-b530-45eff7d29bee" returned: 0 in 0.754s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-79574aed-36f6-4b4c-b530-45eff7d29bee" released by "delete_volume" :: held 1.795s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Created reservations ['785021df-4fec-4e2e-a042-e591b8bc40be', '7678fb22-368f-4410-b6d9-de7d38824bbd', '85dc162f-0414-4d21-994c-64a22e886079', '0299de2c-81ef-48eb-9c03-425c5b5cd7cc'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:47 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:47 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-a5ea567e-354f-4d7e-954d-63045471f14d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-a5ea567e-354f-4d7e-954d-63045471f14d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-quobyte-a5ea567e-354f-4d7e-954d-63045471f14d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-a5ea567e-354f-4d7e-954d-63045471f14d" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eaa2b6-0a16-49f6-a1e0-faf4b5b94683]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:48 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d Jul 07 09:21:48 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:48 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d 1G" returned: 0 in 0.939s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10796112-838f-41c8-af8a-2f19be085c13 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:48 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10796112-838f-41c8-af8a-2f19be085c13 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d Jul 07 09:21:48 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:48 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.793s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Deleted volume successfully. Jul 07 09:21:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-49b6ce5b-ab7b-4e3e-b9e7-5656a9031755 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-79574aed-36f6-4b4c-b530-45eff7d29bee-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:49 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d" returned: 0 in 0.843s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:49 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d Jul 07 09:21:49 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:49 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10796112-838f-41c8-af8a-2f19be085c13 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:49 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d is being set with open permissions: ugo+rw Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:49 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d Jul 07 09:21:49 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:49 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a5ea567e-354f-4d7e-954d-63045471f14d" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:49 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d" returned: 0 in 0.655s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-a5ea567e-354f-4d7e-954d-63045471f14d" released by "delete_volume" :: held 1.585s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=131,cinder:INSERT=37,cinder:UPDATE=142,cinder:DELETE=12 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:49 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info Jul 07 09:21:49 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:49 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Created reservations ['e7c924f6-bde4-47f3-a227-19c3b5ea0e3a', 'd4e891b4-cc59-4dba-be1b-8bc20f80f01e', '9756b991-ee09-4747-9006-2974579de475', 'c29b0905-b1a1-472e-a0bd-e5c5b6410bb5'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:50 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:50 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-e985bb70-c809-42dc-8a0c-5b3a9e4a581c-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-e985bb70-c809-42dc-8a0c-5b3a9e4a581c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-quobyte-e985bb70-c809-42dc-8a0c-5b3a9e4a581c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-e985bb70-c809-42dc-8a0c-5b3a9e4a581c" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcfed6f-a826-429b-ad25-29fd9c412ca9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:50 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info" returned: 0 in 0.753s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:50 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info is being set with open permissions: ugo+rw Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:50 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info Jul 07 09:21:50 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:50 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c Jul 07 09:21:50 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:50 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Deleted volume successfully. Jul 07 09:21:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a6bdfe3-7820-4a4a-a217-ebcef24b1eab tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-a5ea567e-354f-4d7e-954d-63045471f14d-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:51 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.info" returned: 0 in 0.700s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.899s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.797s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Creating offline snapshot 211bf0a3-ac9e-48b2-a65e-1acc14f2f68e of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:21:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-41d9d1fe-6c39-4a88-83a9-d74984b6d44c tempest-VolumesDeleteCascade-2048462040 None] Create snapshot completed successfully Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e903b34b-3496-49f8-9fec-a00919293c4d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:51 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c" returned: 0 in 0.885s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:51 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c Jul 07 09:21:51 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:51 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b Jul 07 09:21:51 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:52 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e985bb70-c809-42dc-8a0c-5b3a9e4a581c" returned: 0 in 0.702s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-e985bb70-c809-42dc-8a0c-5b3a9e4a581c" released by "delete_volume" :: held 1.650s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:52 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b" returned: 0 in 0.827s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Created reservations ['cdc5ad6e-161f-4ac3-9b19-9b794a654c8e', '75cac327-dc05-48d4-a4d9-9df31d4998d1', 'f42d229b-43cd-4faa-bc1d-f08677835862', '2b3ddef3-b858-4933-9a73-7039565f2d3e'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:52 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e 1G Jul 07 09:21:52 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:52 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:52 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:52 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Flow 'volume_create_manager' (10654916-9f8d-4dff-a09f-d9db206d58af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb635105-fac6-4b59-8f0a-a7452ebb38fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "cinder-quobyte-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb635105-fac6-4b59-8f0a-a7452ebb38fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1722168839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23f9da32-d4bb-4015-851d-198f5828e42d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3e8c39c22cd4e71b489dacd90b062be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bf91f6db-7746-4257-9a74-81173af8236d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:53Z,use_quota=True,user_id='f9e3b497820b43e9bc32d5de6e879e6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f845f81e-7e40-49da-8d84-ff3c2685fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f845f81e-7e40-49da-8d84-ff3c2685fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d0a39d-95cf-45e8-8f2e-c3a5e688a5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69d0a39d-95cf-45e8-8f2e-c3a5e688a5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '23f9da32-d4bb-4015-851d-198f5828e42d', 'volume_name': 'volume-23f9da32-d4bb-4015-851d-198f5828e42d', 'volume_size': 1, 'snapshot_id': 'bf91f6db-7746-4257-9a74-81173af8236d'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5545fee0-6ded-4296-ae01-ea0ba42fea56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5545fee0-6ded-4296-ae01-ea0ba42fea56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592f8471-7655-414b-b229-bfea9c31e1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Volume 23f9da32-d4bb-4015-851d-198f5828e42d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-23f9da32-d4bb-4015-851d-198f5828e42d', 'volume_size': 1, 'snapshot_id': 'bf91f6db-7746-4257-9a74-81173af8236d'} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc" acquired by "delete_volume" :: waited 0.097s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c95cc8-a84a-43ca-a487-95d947dc1592]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:53 devstack sudo[98799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc Jul 07 09:21:53 devstack sudo[98799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:53 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.950s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Deleted volume successfully. Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3e046af-4cbf-47e1-af5f-fb1ae1b959c1 tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-e985bb70-c809-42dc-8a0c-5b3a9e4a581c-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:53 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e 1G" returned: 0 in 1.234s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:53 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:21:53 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:54 devstack sudo[98799]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc" returned: 0 in 0.841s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:54 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc Jul 07 09:21:54 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:54 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.769s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:54 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e is being set with open permissions: ugo+rw Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:54 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:21:54 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:54 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-quobyte-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc" released by "delete_volume" :: held 1.567s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Created reservations ['0857d80b-d064-43c6-aab7-721bcca0b613', '4cefe8de-d895-40d9-b06b-660c8c28068e', '1b10f20d-9045-4fb6-8915-9495a70def9b', '34b88767-2c55-4b4f-a9bf-0ffe35936abd'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:54 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:21:54 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:54 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.693s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:55 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info Jul 07 09:21:55 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:55 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.713s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:55 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:21:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Deleted volume successfully. Jul 07 09:21:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7f30208-6143-4b2d-90d1-a6f95e00eacb tempest-CreateVolumesFromImageTest-1360312367 None] Lock "cinder-accd28f6-2e5c-4c37-86eb-e6f6e62d7cdc-delete_volume" released by "delete_volume" :: held 2.676s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:21:55 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info" returned: 0 in 0.681s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:55 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info is being set with open permissions: ugo+rw Jul 07 09:21:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:55 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info Jul 07 09:21:55 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:56 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.info" returned: 0 in 0.691s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.266s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-bf91f6db-7746-4257-9a74-81173af8236d-23f9da32-d4bb-4015-851d-198f5828e42d" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-bf91f6db-7746-4257-9a74-81173af8236d-23f9da32-d4bb-4015-851d-198f5828e42d" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Creating volume 23f9da32-d4bb-4015-851d-198f5828e42d from snapshot bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-23f9da32-d4bb-4015-851d-198f5828e42d" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:21:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ad09812b-233f-4f5e-85c3-ce6fc81948aa tempest-SnapshotsActionsTest-1388511838 None] Create snapshot completed successfully Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-23f9da32-d4bb-4015-851d-198f5828e42d" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] snapshot: bf91f6db-7746-4257-9a74-81173af8236d, volume: 23f9da32-d4bb-4015-851d-198f5828e42d, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de277e0-8336-4190-a1ba-3d4a6d988dc4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:56 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d Jul 07 09:21:56 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:57 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d" returned: 0 in 0.785s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10796112-838f-41c8-af8a-2f19be085c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83423e1-104b-4c7c-8dc3-f6a24bd67f74]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:57 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:21:57 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:21:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (9bf2cea4-abb2-4961-a158-0950ea32cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d66ddb4-9cfe-4b2d-944d-29bda31eba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d66ddb4-9cfe-4b2d-944d-29bda31eba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668957860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803208d5-7b15-4d4a-b024-4b7ae308d54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:58Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c469b22-42b1-4118-92f3-e3818e8038c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c469b22-42b1-4118-92f3-e3818e8038c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f505f0-8ac7-477d-b3e4-d553754b9dcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1f505f0-8ac7-477d-b3e4-d553754b9dcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803208d5-7b15-4d4a-b024-4b7ae308d54f', 'volume_name': 'volume-803208d5-7b15-4d4a-b024-4b7ae308d54f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334be1f6-b009-48fb-a74a-48879a771a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334be1f6-b009-48fb-a74a-48879a771a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bd55ae-5bf8-447f-b23a-cbe2a314799b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:21:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume 803208d5-7b15-4d4a-b024-4b7ae308d54f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803208d5-7b15-4d4a-b024-4b7ae308d54f', 'volume_size': 1} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:21:58 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 0.838s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:21:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:21:58 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d Jul 07 09:21:58 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:02 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d" returned: 0 in 4.777s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[04573cb6-3d35-43f0-b0ee-00f22d8e7e0c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:03 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:22:03 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:03 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 0.913s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:03 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13, size 1024.00 MB, duration 4.78 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:22:03 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Converted 1024.00 MB image at 214.29 MB/s Jul 07 09:22:03 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d is being set with open permissions: ugo+rw Jul 07 09:22:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:03 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d Jul 07 09:22:03 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:04 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d" returned: 0 in 0.667s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-23f9da32-d4bb-4015-851d-198f5828e42d" released by "_copy_volume_from_snapshot" :: held 8.079s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-bf91f6db-7746-4257-9a74-81173af8236d-23f9da32-d4bb-4015-851d-198f5828e42d" released by "_create_volume_from_snapshot" :: held 8.117s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.142s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.801s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Creating offline snapshot 32b45a71-135f-44e0-9e5f-204a68061ea0 of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee84a00-0e06-4931-b728-20d35a30304a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (592f8471-7655-414b-b229-bfea9c31e1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23f9da32-d4bb-4015-851d-198f5828e42d', 'volume_size': 1, 'snapshot_id': 'bf91f6db-7746-4257-9a74-81173af8236d'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205f8fd3-7c22-4cf2-b1b4-d7583954a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Volume volume-23f9da32-d4bb-4015-851d-198f5828e42d (23f9da32-d4bb-4015-851d-198f5828e42d): created successfully Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205f8fd3-7c22-4cf2-b1b4-d7583954a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Flow 'volume_create_manager' (10654916-9f8d-4dff-a09f-d9db206d58af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c98e1c16-704b-4ae8-9bac-0a801bfbf0c9 tempest-VolumesDeleteCascade-2048462040 None] Created volume successfully. Jul 07 09:22:04 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:04 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:05 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.800s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:05 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 1G Jul 07 09:22:05 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-10796112-838f-41c8-af8a-2f19be085c13-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-10796112-838f-41c8-af8a-2f19be085c13-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Performing cascade delete. {{(pid=86769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-bf91f6db-7746-4257-9a74-81173af8236d-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-bf91f6db-7746-4257-9a74-81173af8236d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-10796112-838f-41c8-af8a-2f19be085c13" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-10796112-838f-41c8-af8a-2f19be085c13" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-bf91f6db-7746-4257-9a74-81173af8236d" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-bf91f6db-7746-4257-9a74-81173af8236d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Deleting offline snapshot bf91f6db-7746-4257-9a74-81173af8236d of volume 10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] snapshot_file for this snap is: volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8a15e2-4725-4094-937d-48160d5f4d03]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:06 devstack sudo[98903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d Jul 07 09:22:06 devstack sudo[98903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:06 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 1G" returned: 0 in 0.882s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:06 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 Jul 07 09:22:06 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:06 devstack sudo[98903]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d" returned: 0 in 0.771s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10796112-838f-41c8-af8a-2f19be085c13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069c2dc-ddaa-405b-96e0-9c19338c3999]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:07 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0" returned: 0 in 0.694s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:07 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 is being set with open permissions: ugo+rw Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:07 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 Jul 07 09:22:07 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:07 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:22:07 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:07 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:07 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 0.768s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0" returned: 0 in 0.716s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:07 devstack sudo[98921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d Jul 07 09:22:07 devstack sudo[98921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.211s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.640s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1668957860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803208d5-7b15-4d4a-b024-4b7ae308d54f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:21:58Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Creating volume 803208d5-7b15-4d4a-b024-4b7ae308d54f {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:07 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:07 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f 1073741824 Jul 07 09:22:07 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5cf0c911-53e7-4de5-b3a5-4d141d2f489c tempest-SnapshotsActionsTest-1388511838 None] Create snapshot completed successfully Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-32b45a71-135f-44e0-9e5f-204a68061ea0-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-32b45a71-135f-44e0-9e5f-204a68061ea0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-32b45a71-135f-44e0-9e5f-204a68061ea0" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-32b45a71-135f-44e0-9e5f-204a68061ea0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Deleting offline snapshot 32b45a71-135f-44e0-9e5f-204a68061ea0 of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] snapshot_file for this snap is: volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a317de23-5f80-4ce2-baff-9e586734289b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:08 devstack sudo[98921]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d" returned: 0 in 0.878s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:08 devstack sudo[98933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 Jul 07 09:22:08 devstack sudo[98933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:08 devstack sudo[98935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d Jul 07 09:22:08 devstack sudo[98935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:08 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f 1073741824" returned: 0 in 0.977s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:08 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f Jul 07 09:22:08 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:09 devstack sudo[98935]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13.bf91f6db-7746-4257-9a74-81173af8236d" returned: 0 in 0.742s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-bf91f6db-7746-4257-9a74-81173af8236d" released by "_delete_snapshot" :: held 3.260s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:09 devstack sudo[98933]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-10796112-838f-41c8-af8a-2f19be085c13" released by "delete_snapshot" :: held 3.288s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0" returned: 0 in 0.898s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb744a5-df98-48f4-aa12-153e9a8fd27f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Created reservations ['b1d8692b-f7a1-41fb-971d-4d4e40720e44', 'bc42f034-6356-45fb-9ed4-ea70045c090b', '3e9b5f33-d40d-4ff0-ae76-06e4a8fdd5d2', 'eb1c7486-cf68-40a2-a89a-ebaadb7bb3a9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:09 devstack sudo[98952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:09 devstack sudo[98952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:09 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f" returned: 0 in 0.738s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.592s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0bd55ae-5bf8-447f-b23a-cbe2a314799b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803208d5-7b15-4d4a-b024-4b7ae308d54f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaafbb2d-9113-4b54-9a30-64de1229d9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[138071ab-fca1-42fb-9100-9eaf0f1f35e7]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Delete snapshot completed successfully. Jul 07 09:22:09 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume volume-803208d5-7b15-4d4a-b024-4b7ae308d54f (803208d5-7b15-4d4a-b024-4b7ae308d54f): created successfully Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaafbb2d-9113-4b54-9a30-64de1229d9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (9bf2cea4-abb2-4961-a158-0950ea32cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-bf91f6db-7746-4257-9a74-81173af8236d-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Snapshots deleted, issuing volume delete {{(pid=86769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-10796112-838f-41c8-af8a-2f19be085c13" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-12995e34-aa66-4dc6-bbdf-160b466517e7 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created volume successfully. Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-10796112-838f-41c8-af8a-2f19be085c13" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f44faab-a68f-48a1-ba69-17f5db631331]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:09 devstack sudo[98955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 Jul 07 09:22:09 devstack sudo[98955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:09 devstack sudo[98956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:22:09 devstack sudo[98956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:10 devstack sudo[98952]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.861s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:10 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 Jul 07 09:22:10 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:10 devstack sudo[98955]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (16c87b53-c5f7-4cd4-b54a-eceabc289f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a5b6e-16e6-47e8-8cb9-56b88edda191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10" returned: 0 in 1.047s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.092s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6a5b6e-16e6-47e8-8cb9-56b88edda191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1716317081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67570448-5d59-487a-b5cc-939928a3a73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:11Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00c953e-f466-4da1-868b-d068129d4c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b00c953e-f466-4da1-868b-d068129d4c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe6c6d0-80fb-4331-a53f-09eab2d8834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe6c6d0-80fb-4331-a53f-09eab2d8834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67570448-5d59-487a-b5cc-939928a3a73c', 'volume_name': 'volume-67570448-5d59-487a-b5cc-939928a3a73c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17bcb62-7acf-41f2-8dfc-26cc3f526b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:10 devstack sudo[98956]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d17bcb62-7acf-41f2-8dfc-26cc3f526b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129ca6ab-9799-4f1e-a81b-168dcbae56d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:10 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume 67570448-5d59-487a-b5cc-939928a3a73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67570448-5d59-487a-b5cc-939928a3a73c', 'volume_size': 1} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1716317081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67570448-5d59-487a-b5cc-939928a3a73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:11Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Creating volume 67570448-5d59-487a-b5cc-939928a3a73c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:10 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 1.049s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:10 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c 1073741824 Jul 07 09:22:10 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:10 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13 Jul 07 09:22:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-428642ef-061d-4277-970d-de714024ab10', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b22f8e9-e4ca-45ae-add9-df47b3e5aeb5', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:22:10 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-3b847c5d-02d7-4f46-830f-11de2c13661e req-073f9c9f-6739-4435-b46e-a5ffa38b7622 tempest-TestServerVolumeAttachmentScenario-1210504325 None] attachment_update completed successfully. Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (814a90b0-7da4-46b3-ba7e-58adb14191d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886b3181-c88f-417a-b7fe-5e51b160a56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (886b3181-c88f-417a-b7fe-5e51b160a56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897529751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9f30f6-843c-4e96-864d-bdae18080fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:11Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6c544d-5e68-4c60-89eb-04f5c752823d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a6c544d-5e68-4c60-89eb-04f5c752823d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170eb881-2da7-412e-8410-bc28722d5d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (170eb881-2da7-412e-8410-bc28722d5d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d9f30f6-843c-4e96-864d-bdae18080fd4', 'volume_name': 'volume-2d9f30f6-843c-4e96-864d-bdae18080fd4', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f99e63-884e-4698-95d5-665ae3f9d00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f99e63-884e-4698-95d5-665ae3f9d00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6460339b-b567-4fb0-b31f-30656ff3c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume 2d9f30f6-843c-4e96-864d-bdae18080fd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d9f30f6-843c-4e96-864d-bdae18080fd4', 'volume_size': 1} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:11 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0" returned: 0 in 1.127s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:11 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0 Jul 07 09:22:11 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:11 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-10796112-838f-41c8-af8a-2f19be085c13" returned: 0 in 0.966s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-10796112-838f-41c8-af8a-2f19be085c13" released by "delete_volume" :: held 2.083s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Created reservations ['b0ef9547-749e-4cfd-bca8-b229541d0f41', '1fa3b199-791e-48e7-96dd-247ab6b3d7e8', 'c36fb1bd-1b80-497d-90c1-efd689751cbc', 'bec389e5-1e49-46c9-9f37-a2fa3e127a00'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (9f2f8e1e-3fa3-4a0d-8cbe-0af5f5d077b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0922c0f0-b70b-4361-ad17-bdb8a20494c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0922c0f0-b70b-4361-ad17-bdb8a20494c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106775934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91048e5-37d1-4c16-820d-7045978bf792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:12Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700721c2-531e-4401-b482-181fd23fa0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (700721c2-531e-4401-b482-181fd23fa0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fa6890-dae1-46cd-a906-82fbffd88908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05fa6890-dae1-46cd-a906-82fbffd88908) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a91048e5-37d1-4c16-820d-7045978bf792', 'volume_name': 'volume-a91048e5-37d1-4c16-820d-7045978bf792', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed42df6-5359-41f9-a786-0e055a6addf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed42df6-5359-41f9-a786-0e055a6addf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaeff439-52af-4755-b94d-56260d215b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume a91048e5-37d1-4c16-820d-7045978bf792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a91048e5-37d1-4c16-820d-7045978bf792', 'volume_size': 1} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c 1073741824" returned: 0 in 1.370s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:12 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:12 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:12 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c Jul 07 09:22:12 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:12 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.32b45a71-135f-44e0-9e5f-204a68061ea0" returned: 0 in 1.126s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-32b45a71-135f-44e0-9e5f-204a68061ea0" released by "_delete_snapshot" :: held 4.130s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" released by "delete_snapshot" :: held 4.173s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (4c19f99d-4d51-4d2b-a932-0092f133366d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d83b14a-319f-4925-8484-8de6f3732350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d83b14a-319f-4925-8484-8de6f3732350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1350965575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1118c94-f07e-4abb-9ae7-a042f9c39ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:12Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd984a6d-2cd1-4648-93eb-7d3a29848031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd984a6d-2cd1-4648-93eb-7d3a29848031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb5528c-22c9-45ec-b54d-d1ea01d4cf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eb5528c-22c9-45ec-b54d-d1ea01d4cf21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1118c94-f07e-4abb-9ae7-a042f9c39ace', 'volume_name': 'volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9020350c-d233-4cd4-8bf3-90aa4754df8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9020350c-d233-4cd4-8bf3-90aa4754df8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f293b1a-e7eb-4f40-9a98-d7daf09f320c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume b1118c94-f07e-4abb-9ae7-a042f9c39ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace', 'volume_size': 1} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Created reservations ['6232b87a-5797-4433-945b-08a202f3d7ac', '445047bd-bcfb-4cbc-b833-a1244537f068', 'f7edbaf1-7a87-4c81-b752-5886413f3dea', '26e17c63-18dc-488a-8671-ae6106f08395'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-23f9da32-d4bb-4015-851d-198f5828e42d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-23f9da32-d4bb-4015-851d-198f5828e42d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Delete snapshot completed successfully. Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-40c8aef8-3389-4831-b20b-a4e1ad2a49e4 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-32b45a71-135f-44e0-9e5f-204a68061ea0-delete_snapshot" released by "delete_snapshot" :: held 4.636s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "cinder-quobyte-23f9da32-d4bb-4015-851d-198f5828e42d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:13 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-23f9da32-d4bb-4015-851d-198f5828e42d" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.057s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa0ba102-ec6e-49a2-a5d8-0e2c5eff5e22]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Deleted volume successfully. Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8916374d-7b13-470a-bdbf-23d76297bc84 tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-10796112-838f-41c8-af8a-2f19be085c13-delete_volume" released by "delete_volume" :: held 7.280s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:13 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d Jul 07 09:22:13 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (40e7b52b-3670-42af-9723-8aa5d5fa3091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:13 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e329a5f7-c639-4ff0-a501-c8a0886d22f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c" returned: 0 in 1.229s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] <== create_volume: return (2691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.695s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-897529751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d9f30f6-843c-4e96-864d-bdae18080fd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:11Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Creating volume 2d9f30f6-843c-4e96-864d-bdae18080fd4 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:13 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e329a5f7-c639-4ff0-a501-c8a0886d22f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-169699656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8904be-aea8-4264-863f-7c1464b41787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:13Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387d99cf-d698-4e7a-affd-27214b589571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387d99cf-d698-4e7a-affd-27214b589571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:13 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 1073741824 Jul 07 09:22:13 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d11be09-0e21-4624-b070-64d2575b9f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d11be09-0e21-4624-b070-64d2575b9f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce8904be-aea8-4264-863f-7c1464b41787', 'volume_name': 'volume-ce8904be-aea8-4264-863f-7c1464b41787', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb573ce-9229-45c4-a352-49f090f95ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb573ce-9229-45c4-a352-49f090f95ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eacf7735-ef7e-477c-8626-d0fb08e4483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume ce8904be-aea8-4264-863f-7c1464b41787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce8904be-aea8-4264-863f-7c1464b41787', 'volume_size': 1} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (129ca6ab-9799-4f1e-a81b-168dcbae56d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67570448-5d59-487a-b5cc-939928a3a73c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccdd926-c9f3-4403-b3d7-7ec51369dd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume volume-67570448-5d59-487a-b5cc-939928a3a73c (67570448-5d59-487a-b5cc-939928a3a73c): created successfully Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccdd926-c9f3-4403-b3d7-7ec51369dd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (16c87b53-c5f7-4cd4-b54a-eceabc289f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-59093609-a69e-4b73-bf6d-7e07fe8ae982 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created volume successfully. Jul 07 09:22:14 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d" returned: 0 in 0.842s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:14 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d Jul 07 09:22:14 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:14 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 1073741824" returned: 0 in 0.949s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:14 devstack sudo[99389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 Jul 07 09:22:14 devstack sudo[99389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:14 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-23f9da32-d4bb-4015-851d-198f5828e42d" returned: 0 in 0.650s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-quobyte-23f9da32-d4bb-4015-851d-198f5828e42d" released by "delete_volume" :: held 1.573s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Created reservations ['c3baadd8-1772-4438-afe2-ee61692a0465', '6c1009d0-4ede-458b-b16b-1933b4e944b3', '12c54750-e106-4d94-b825-584f67e513fc', 'dc65db98-c861-497b-b83f-a3ecbb52075f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:14 devstack sudo[99392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:14 devstack sudo[99392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:15 devstack sudo[99389]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4" returned: 0 in 0.677s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] <== create_volume: return (1667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.671s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.996s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2106775934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a91048e5-37d1-4c16-820d-7045978bf792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:12Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Creating volume a91048e5-37d1-4c16-820d-7045978bf792 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:15 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6460339b-b567-4fb0-b31f-30656ff3c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d9f30f6-843c-4e96-864d-bdae18080fd4', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:15 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 1073741824 Jul 07 09:22:15 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef79d0c-bac2-48fc-a191-b7e02b386228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:15 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 (2d9f30f6-843c-4e96-864d-bdae18080fd4): created successfully Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eef79d0c-bac2-48fc-a191-b7e02b386228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (814a90b0-7da4-46b3-ba7e-58adb14191d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4bf2b7a4-0d5f-4fed-bcc9-27fc18016d7e tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created volume successfully. Jul 07 09:22:15 devstack sudo[99392]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.755s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Deleted volume successfully. Jul 07 09:22:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-db8f6333-ea30-4538-98af-f3be31bbc1ac tempest-VolumesDeleteCascade-2048462040 None] Lock "cinder-23f9da32-d4bb-4015-851d-198f5828e42d-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:16 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 1073741824" returned: 0 in 1.071s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:16 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 Jul 07 09:22:16 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:17 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792" returned: 0 in 0.824s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.952s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.238s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1350965575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1118c94-f07e-4abb-9ae7-a042f9c39ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:12Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Creating volume b1118c94-f07e-4abb-9ae7-a042f9c39ace {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:17 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aaeff439-52af-4755-b94d-56260d215b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a91048e5-37d1-4c16-820d-7045978bf792', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:17 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace 1073741824 Jul 07 09:22:17 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae92853c-8a4a-4ddf-a29c-395f3e562ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:17 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume volume-a91048e5-37d1-4c16-820d-7045978bf792 (a91048e5-37d1-4c16-820d-7045978bf792): created successfully Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae92853c-8a4a-4ddf-a29c-395f3e562ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (9f2f8e1e-3fa3-4a0d-8cbe-0af5f5d077b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6774a4b6-8977-40f5-aac8-8f0a634b0682 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created volume successfully. Jul 07 09:22:17 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace 1073741824" returned: 0 in 0.908s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:18 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace Jul 07 09:22:18 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:18 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace" returned: 0 in 0.702s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.214s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-169699656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce8904be-aea8-4264-863f-7c1464b41787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dedb0386e7f84b3ab802c025d55039aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:13Z,use_quota=True,user_id='7a97d062fc954e11b573dab3b9a50e6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Creating volume ce8904be-aea8-4264-863f-7c1464b41787 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:18 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f293b1a-e7eb-4f40-9a98-d7daf09f320c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:18 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 1073741824 Jul 07 09:22:18 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24ae310-d990-436d-9444-8a55e7a8213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace (b1118c94-f07e-4abb-9ae7-a042f9c39ace): created successfully Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e24ae310-d990-436d-9444-8a55e7a8213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (4c19f99d-4d51-4d2b-a932-0092f133366d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cce8522e-9f63-4a15-b814-e2b83888c3a9 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created volume successfully. Jul 07 09:22:19 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 1073741824" returned: 0 in 0.903s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:19 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 Jul 07 09:22:19 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Flow 'volume_create_manager' (6579b5ee-1ab6-43a3-b931-38be17e32ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b083fbf-ca83-494b-90a8-7a7ee85d6b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b083fbf-ca83-494b-90a8-7a7ee85d6b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1731602108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829be46d-262a-4567-8696-d864f3041d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fe8fcb89494a31b16de79279d0ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:20Z,use_quota=True,user_id='d49832e9ced7424daab5f479525a0595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56a8a0c-e717-423e-84db-142fb778a9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c56a8a0c-e717-423e-84db-142fb778a9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae36bf9-e409-496e-91cd-107607f218fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae36bf9-e409-496e-91cd-107607f218fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '829be46d-262a-4567-8696-d864f3041d5e', 'volume_name': 'volume-829be46d-262a-4567-8696-d864f3041d5e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3159584c-88e4-41d0-a5cd-b1c71c1c3711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3159584c-88e4-41d0-a5cd-b1c71c1c3711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa892e7d-3ce3-4790-99ba-7bffa35074bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Volume 829be46d-262a-4567-8696-d864f3041d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-829be46d-262a-4567-8696-d864f3041d5e', 'volume_size': 1} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:20 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.835s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Creating offline snapshot 7df616cb-5468-48dd-b983-0d41cbdb30b0 of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eacf7735-ef7e-477c-8626-d0fb08e4483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce8904be-aea8-4264-863f-7c1464b41787', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0855f6d0-c40a-4d7a-802c-f5990f174b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[89860ed4-99c2-4cf4-a65f-0e7a56ea2591]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Volume volume-ce8904be-aea8-4264-863f-7c1464b41787 (ce8904be-aea8-4264-863f-7c1464b41787): created successfully Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0855f6d0-c40a-4d7a-802c-f5990f174b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Flow 'volume_create_manager' (40e7b52b-3670-42af-9723-8aa5d5fa3091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0afffa21-afbe-41b7-96a8-53c57d5421ab tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created volume successfully. Jul 07 09:22:20 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:20 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-ce8904be-aea8-4264-863f-7c1464b41787-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-ce8904be-aea8-4264-863f-7c1464b41787-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-quobyte-ce8904be-aea8-4264-863f-7c1464b41787" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-ce8904be-aea8-4264-863f-7c1464b41787" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1095d61-1121-4009-8908-ecc44b384fb9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:21 devstack sudo[99428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 Jul 07 09:22:21 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:21 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:21 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 1G Jul 07 09:22:21 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:21 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787" returned: 0 in 0.849s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:21 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787 Jul 07 09:22:21 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:22 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 1G" returned: 0 in 0.877s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:22 devstack sudo[99454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 Jul 07 09:22:22 devstack sudo[99454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:22 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce8904be-aea8-4264-863f-7c1464b41787" returned: 0 in 0.681s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-ce8904be-aea8-4264-863f-7c1464b41787" released by "delete_volume" :: held 1.585s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created reservations ['c3d2e8d6-2f1b-4416-b443-28ce2c414c45', '762bbc92-ad7b-45ea-823f-84403665f1ac', '053caf59-9d15-4221-b7c9-6f726a258ce3', 'e1fb50c8-b8b8-4d4d-83f2-e196932bb2c7'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:22 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:22 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:22 devstack sudo[99454]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0" returned: 0 in 0.740s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:22 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 is being set with open permissions: ugo+rw Jul 07 09:22:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:22 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 Jul 07 09:22:22 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-b1118c94-f07e-4abb-9ae7-a042f9c39ace-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-b1118c94-f07e-4abb-9ae7-a042f9c39ace-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-quobyte-b1118c94-f07e-4abb-9ae7-a042f9c39ace" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-b1118c94-f07e-4abb-9ae7-a042f9c39ace" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e27b4-35c7-44a6-80dc-a0bf7539f4da]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:23 devstack sudo[99465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace Jul 07 09:22:23 devstack sudo[99465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:23 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.721s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Deleted volume successfully. Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-708cf6d5-a0ab-48dc-aeb1-a696285f9924 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-ce8904be-aea8-4264-863f-7c1464b41787-delete_volume" released by "delete_volume" :: held 2.539s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:23 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0" returned: 0 in 0.700s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.320s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1731602108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=829be46d-262a-4567-8696-d864f3041d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fe8fcb89494a31b16de79279d0ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:20Z,use_quota=True,user_id='d49832e9ced7424daab5f479525a0595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Creating volume 829be46d-262a-4567-8696-d864f3041d5e {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:23 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:23 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e 1073741824 Jul 07 09:22:23 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1d3393ca-01df-4885-9780-932e732e210d tempest-SnapshotsActionsTest-1388511838 None] Create snapshot completed successfully Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-7df616cb-5468-48dd-b983-0d41cbdb30b0-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-7df616cb-5468-48dd-b983-0d41cbdb30b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:24 devstack sudo[99465]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-7df616cb-5468-48dd-b983-0d41cbdb30b0" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-7df616cb-5468-48dd-b983-0d41cbdb30b0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Deleting offline snapshot 7df616cb-5468-48dd-b983-0d41cbdb30b0 of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:22:24 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace Jul 07 09:22:24 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] snapshot_file for this snap is: volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96934aa-ae3a-485d-99be-73d4aa02114d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:24 devstack sudo[99476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 Jul 07 09:22:24 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:24 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e 1073741824" returned: 0 in 0.852s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:24 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e Jul 07 09:22:24 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:24 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b1118c94-f07e-4abb-9ae7-a042f9c39ace" returned: 0 in 0.721s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-b1118c94-f07e-4abb-9ae7-a042f9c39ace" released by "delete_volume" :: held 1.633s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=129,cinder:UPDATE=182,cinder:DELETE=11,cinder:INSERT=37 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:22:24 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created reservations ['a3ce27dd-9b5e-402c-945c-965c7f699fbe', '7473c0fe-2dad-4038-84b2-a79e64a5b644', '0b5a3054-cb7d-4ac8-9e42-828546b1be85', 'acaffa11-1d24-483f-993e-430017e956cd'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:25 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0" returned: 0 in 0.860s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:25 devstack sudo[99488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:25 devstack sudo[99488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeac6d5-d20e-4438-93ee-6a9c4829b68f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:25 devstack sudo[99490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:25 devstack sudo[99490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:25 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e" returned: 0 in 0.687s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.215s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa892e7d-3ce3-4790-99ba-7bffa35074bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-829be46d-262a-4567-8696-d864f3041d5e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7095d6d6-91b8-4c9a-a54e-956a1dc61562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1736a37-1b21-4423-9998-d18b684b2c75]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:25 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Volume volume-829be46d-262a-4567-8696-d864f3041d5e (829be46d-262a-4567-8696-d864f3041d5e): created successfully Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7095d6d6-91b8-4c9a-a54e-956a1dc61562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Flow 'volume_create_manager' (6579b5ee-1ab6-43a3-b931-38be17e32ee1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-284ebeac-323a-463a-9f91-87992ac3517f tempest-VolumesTransfersTest-435923988 None] Created volume successfully. Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-a91048e5-37d1-4c16-820d-7045978bf792-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-a91048e5-37d1-4c16-820d-7045978bf792-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:25 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 Jul 07 09:22:25 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-quobyte-a91048e5-37d1-4c16-820d-7045978bf792" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-a91048e5-37d1-4c16-820d-7045978bf792" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7c542f-5f08-4634-b486-9a049a5f9e05]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:25 devstack sudo[99488]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.731s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Deleted volume successfully. Jul 07 09:22:25 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 Jul 07 09:22:25 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d914b8c-7f6c-4b72-a2f8-6cd322f78f8f tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-b1118c94-f07e-4abb-9ae7-a042f9c39ace-delete_volume" released by "delete_volume" :: held 2.643s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:25 devstack sudo[99490]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.925s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:26 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 Jul 07 09:22:26 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f572891b-ef20-4868-aaae-a3866b88a4e2 tempest-VolumesTransfersTest-1899002735 None] Transfer volume completed successfully. Jul 07 09:22:26 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" returned: 0 in 1.130s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.166s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f76074f-9607-483e-b301-9aeef664811e', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:22:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-aec45ef7-2052-4c14-820f-7bdeb2c6a018 req-acf3583b-421d-4620-b9b6-2b22bbf9faac tempest-TestServerVolumeAttachmentScenario-1210504325 None] attachment_update completed successfully. Jul 07 09:22:26 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792" returned: 0 in 1.018s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:26 devstack sudo[99509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792 Jul 07 09:22:26 devstack sudo[99509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:26 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0" returned: 0 in 0.861s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:26 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0 Jul 07 09:22:26 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:27 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:27 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:27 devstack sudo[99509]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a91048e5-37d1-4c16-820d-7045978bf792" returned: 0 in 0.797s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-a91048e5-37d1-4c16-820d-7045978bf792" released by "delete_volume" :: held 1.879s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Acquiring lock "cinder-829be46d-262a-4567-8696-d864f3041d5e-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-829be46d-262a-4567-8696-d864f3041d5e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Acquiring lock "cinder-quobyte-829be46d-262a-4567-8696-d864f3041d5e" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created reservations ['4fad0e55-ad0a-439d-bc69-f1ea9a9f121e', 'ddc34023-1a3b-4f5b-b37b-e41dbd053314', 'c4ae1d78-c326-439b-ab6c-45df9d60ba80', 'fd5ad613-4d95-4d61-b409-c803bdf5f86d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-quobyte-829be46d-262a-4567-8696-d864f3041d5e" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9697425b-c174-4901-88ca-d4a0d4ca1424]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:27 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:27 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:27 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:27 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e Jul 07 09:22:27 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.7df616cb-5468-48dd-b983-0d41cbdb30b0" returned: 0 in 0.885s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-7df616cb-5468-48dd-b983-0d41cbdb30b0" released by "_delete_snapshot" :: held 3.645s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" released by "delete_snapshot" :: held 3.687s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Created reservations ['4eb850fa-5069-421c-8fff-2110ea922621', 'e55bc374-7a0a-42a9-8ab6-01d8f615360d', 'ddda251b-9ea0-42f0-a690-86bcafd5a5fa', '9e869d31-7ad6-4dc3-b1f1-1b81488aa092'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:27 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.027s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:22:28 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Delete snapshot completed successfully. Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4eee77c1-7c7d-4afc-bdba-ab75af4c36e9 tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-7df616cb-5468-48dd-b983-0d41cbdb30b0-delete_snapshot" released by "delete_snapshot" :: held 3.944s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-2d9f30f6-843c-4e96-864d-bdae18080fd4-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-2d9f30f6-843c-4e96-864d-bdae18080fd4-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-quobyte-2d9f30f6-843c-4e96-864d-bdae18080fd4" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-2d9f30f6-843c-4e96-864d-bdae18080fd4" acquired by "delete_volume" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e1a1b-9182-48dc-904f-7d643721d9f0]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:28 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.887s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:28 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Deleted volume successfully. Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:28 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 Jul 07 09:22:28 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5eeedc-d27a-4e3e-a03f-cbe198ba35df tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-a91048e5-37d1-4c16-820d-7045978bf792-delete_volume" released by "delete_volume" :: held 3.107s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Creating offline snapshot e71df637-cae5-4842-82de-765b6df9c698 of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[701e803a-9922-41aa-b467-bf1e9c4d3c2c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:28 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e" returned: 0 in 1.125s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:28 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e Jul 07 09:22:28 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:28 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:28 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:29 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:29 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4 Jul 07 09:22:29 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:29 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-829be46d-262a-4567-8696-d864f3041d5e" returned: 0 in 0.705s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:29 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-quobyte-829be46d-262a-4567-8696-d864f3041d5e" released by "delete_volume" :: held 1.906s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.819s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:29 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 1G Jul 07 09:22:29 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Created reservations ['fe38c520-fb4d-4a02-a1ac-835c4ea6b27c', '9f421713-748b-4a14-b8bd-3b580c6b1dc2', 'a28d281e-94f8-4f0f-bbfb-ad29402a8186', 'ad5be9b9-d8e5-4183-a949-80478fe4d9ed'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:29 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:29 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:29 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2d9f30f6-843c-4e96-864d-bdae18080fd4" returned: 0 in 0.698s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-2d9f30f6-843c-4e96-864d-bdae18080fd4" released by "delete_volume" :: held 1.579s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created reservations ['725b29b4-d5a4-4206-b9cc-de0e4378ded2', '7833ed2f-5ef3-475c-ade8-d1e4d347f521', '277de8c5-47b0-4e81-ba59-49b0eb417941', '5d13a380-bc9d-456e-8284-d8dcc953cdae'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:30 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:30 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Flow 'volume_create_manager' (1dda980d-b37b-40dc-8b2f-9df85ade315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9783fc88-1631-4e77-b62a-d32bdbc0a59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9783fc88-1631-4e77-b62a-d32bdbc0a59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-733983305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a58a9-c6bb-477f-a458-7698d97e7a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fe8fcb89494a31b16de79279d0ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:30Z,use_quota=True,user_id='d49832e9ced7424daab5f479525a0595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff787a3d-121e-47d8-a13f-b5a8977c507d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff787a3d-121e-47d8-a13f-b5a8977c507d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c4c7f5-9e01-4c6a-8622-8be6c86842ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c4c7f5-9e01-4c6a-8622-8be6c86842ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0a58a9-c6bb-477f-a458-7698d97e7a15', 'volume_name': 'volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e63a70-0ebe-4c54-8b1b-b68cd815ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e63a70-0ebe-4c54-8b1b-b68cd815ad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917b3439-04fd-4852-a8ee-4962a3824e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:30 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Volume 5b0a58a9-c6bb-477f-a458-7698d97e7a15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15', 'volume_size': 1} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:30 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 1G" returned: 0 in 0.996s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:30 devstack sudo[99558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 Jul 07 09:22:30 devstack sudo[99558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:30 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.963s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Deleted volume successfully. Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b19f9fec-a005-4a96-8f06-c14d4ae5f05d tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-829be46d-262a-4567-8696-d864f3041d5e-delete_volume" released by "delete_volume" :: held 3.133s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-67570448-5d59-487a-b5cc-939928a3a73c-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-67570448-5d59-487a-b5cc-939928a3a73c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-quobyte-67570448-5d59-487a-b5cc-939928a3a73c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-67570448-5d59-487a-b5cc-939928a3a73c" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aed6445-e6d2-40b3-bff1-55511c5a6de6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:30 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c Jul 07 09:22:30 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:30 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.774s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Deleted volume successfully. Jul 07 09:22:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53ead1d1-2134-413c-96a7-6522124f4499 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-2d9f30f6-843c-4e96-864d-bdae18080fd4-delete_volume" released by "delete_volume" :: held 2.690s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:31 devstack sudo[99558]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698" returned: 0 in 0.806s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:31 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 is being set with open permissions: ugo+rw Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:31 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 Jul 07 09:22:31 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:31 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c" returned: 0 in 0.806s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:31 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c Jul 07 09:22:31 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:31 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698" returned: 0 in 0.686s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.445s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.554s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-733983305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0a58a9-c6bb-477f-a458-7698d97e7a15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50fe8fcb89494a31b16de79279d0ecfd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:30Z,use_quota=True,user_id='d49832e9ced7424daab5f479525a0595',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Creating volume 5b0a58a9-c6bb-477f-a458-7698d97e7a15 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:32 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:32 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 1073741824 Jul 07 09:22:32 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b66f5fff-5e13-451e-943a-d6b8bae81341 tempest-SnapshotsActionsTest-1388511838 None] Create snapshot completed successfully Jul 07 09:22:32 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-67570448-5d59-487a-b5cc-939928a3a73c" returned: 0 in 0.705s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-67570448-5d59-487a-b5cc-939928a3a73c" released by "delete_volume" :: held 1.561s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created reservations ['430a56ea-319b-4b03-ba0e-1c86c5a08917', '3a57e8fa-bfda-4377-957a-6c68f43f5016', '4ab9245e-7bfa-42e0-afd7-8086f976ba6f', 'c1090485-cb06-4603-9a8f-323f45d17845'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:32 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:32 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-e71df637-cae5-4842-82de-765b6df9c698-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-e71df637-cae5-4842-82de-765b6df9c698-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-e71df637-cae5-4842-82de-765b6df9c698" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-803208d5-7b15-4d4a-b024-4b7ae308d54f-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-e71df637-cae5-4842-82de-765b6df9c698" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Deleting offline snapshot e71df637-cae5-4842-82de-765b6df9c698 of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] snapshot_file for this snap is: volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e81f6-1c6b-4e9d-b728-54a11778c87f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-803208d5-7b15-4d4a-b024-4b7ae308d54f-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:33 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 1073741824" returned: 0 in 1.041s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "cinder-quobyte-803208d5-7b15-4d4a-b024-4b7ae308d54f" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-803208d5-7b15-4d4a-b024-4b7ae308d54f" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9d6cb3-b60f-4c2b-a513-65d19782c1dc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:33 devstack sudo[99608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 Jul 07 09:22:33 devstack sudo[99608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:33 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 Jul 07 09:22:33 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:33 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.849s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Deleted volume successfully. Jul 07 09:22:33 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f Jul 07 09:22:33 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-650d4066-3eed-47fc-913f-188fd1bb920a tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-67570448-5d59-487a-b5cc-939928a3a73c-delete_volume" released by "delete_volume" :: held 2.632s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-0a00cdc3-227a-45e0-a37d-3149333acbc1 req-4f7e5b93-1aec-4c5d-802a-2d78726cee0f tempest-TestServerVolumeAttachmentScenario-1210504325 None] Terminate volume connection completed successfully. Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-0a00cdc3-227a-45e0-a37d-3149333acbc1 req-4f7e5b93-1aec-4c5d-802a-2d78726cee0f tempest-TestServerVolumeAttachmentScenario-1210504325 None] Deleting attachment 9f76074f-9607-483e-b301-9aeef664811e. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:22:33 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15" returned: 0 in 0.749s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (917b3439-04fd-4852-a8ee-4962a3824e54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407a9d7f-5f0e-4eb5-bcd4-e68f5b939efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:33 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Volume volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 (5b0a58a9-c6bb-477f-a458-7698d97e7a15): created successfully Jul 07 09:22:33 devstack sudo[99608]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407a9d7f-5f0e-4eb5-bcd4-e68f5b939efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:33 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Flow 'volume_create_manager' (1dda980d-b37b-40dc-8b2f-9df85ade315a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698" returned: 0 in 0.997s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f" returned: 0 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6880b321-06ed-4a50-b944-f9daff41a659]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-61cee73f-31ac-441b-83bc-2ea20409c949 tempest-VolumesTransfersTest-435923988 None] Created volume successfully. Jul 07 09:22:34 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f Jul 07 09:22:34 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:34 devstack sudo[99625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:34 devstack sudo[99625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:34 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-803208d5-7b15-4d4a-b024-4b7ae308d54f" returned: 0 in 0.708s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-quobyte-803208d5-7b15-4d4a-b024-4b7ae308d54f" released by "delete_volume" :: held 1.637s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Created reservations ['f84ae3f7-920b-49fd-9fc3-0f8a89f72b90', 'a2aa101a-bc2a-47b8-bf6c-46573cbe3366', 'fb11f614-713e-44bd-bb9a-fee21953fb01', '0200ad63-754e-41da-b0f0-4f3ae45a07f6'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Acquiring lock "cinder-5b0a58a9-c6bb-477f-a458-7698d97e7a15-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-5b0a58a9-c6bb-477f-a458-7698d97e7a15-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:34 devstack sudo[99625]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.881s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:34 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:34 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:34 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 Jul 07 09:22:34 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Acquiring lock "cinder-quobyte-5b0a58a9-c6bb-477f-a458-7698d97e7a15" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-quobyte-5b0a58a9-c6bb-477f-a458-7698d97e7a15" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[517793a5-0d18-4b23-8809-4e46a82eb329]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:35 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 Jul 07 09:22:35 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:35 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.911s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Deleted volume successfully. Jul 07 09:22:35 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2fc11de5-e5dd-413d-8cc0-8ff0a26ce993 tempest-CreateVolumesFromSourceVolumeTest-180893350 None] Lock "cinder-803208d5-7b15-4d4a-b024-4b7ae308d54f-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698" returned: 0 in 0.935s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:35 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698 Jul 07 09:22:35 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:36 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15" returned: 0 in 1.136s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:36 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15 Jul 07 09:22:36 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:36 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.e71df637-cae5-4842-82de-765b6df9c698" returned: 0 in 0.853s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-e71df637-cae5-4842-82de-765b6df9c698" released by "_delete_snapshot" :: held 3.838s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" released by "delete_snapshot" :: held 3.883s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Created reservations ['9e056f57-c21c-40ab-983f-644109c36028', '1b3ac231-afd8-4200-a344-0f23e38b91fb', 'bf3eb267-eb58-4bab-ab5b-acfd808ba165', '2ba62a02-b9f0-436e-9266-a58e67a24e95'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:36 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5b0a58a9-c6bb-477f-a458-7698d97e7a15" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-quobyte-5b0a58a9-c6bb-477f-a458-7698d97e7a15" released by "delete_volume" :: held 1.927s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Delete snapshot completed successfully. Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87aff402-c8b5-457b-9ae9-2574ea04769a tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-e71df637-cae5-4842-82de-765b6df9c698-delete_snapshot" released by "delete_snapshot" :: held 4.069s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:36 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Created reservations ['1d641c52-45b0-461a-bc62-8bc0831d2f5d', '919cec3f-ae8e-4d2d-9a68-401f25b8be49', '259d1e17-e691-4a78-a856-7cc5b5404772', 'e8ab131b-5d3a-48ec-acf3-b2151b690ec5'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:37 devstack sudo[99660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:37 devstack sudo[99660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-aefc7761-8b2f-4444-8725-1033d9f5d57a req-b110ec95-caba-4467-96ec-8b38ceccb6e5 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Terminate volume connection completed successfully. Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-aefc7761-8b2f-4444-8725-1033d9f5d57a req-b110ec95-caba-4467-96ec-8b38ceccb6e5 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Deleting attachment 2b22f8e9-e4ca-45ae-add9-df47b3e5aeb5. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Creating offline snapshot d0d3cf24-7c07-47a4-ab47-5c305c533a7e of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef249c5-ee93-4d9a-ab67-d046dfef6665]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:37 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:37 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:38 devstack sudo[99660]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.089s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:38 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:38 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Deleted volume successfully. Jul 07 09:22:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb7a1e04-66ac-45ee-9783-a094d8300259 tempest-VolumesTransfersTest-1412274152 None] Lock "cinder-5b0a58a9-c6bb-477f-a458-7698d97e7a15-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:38 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.939s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:38 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e 1G Jul 07 09:22:38 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:39 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e 1G" returned: 0 in 0.913s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:39 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e Jul 07 09:22:39 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:40 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e" returned: 0 in 0.807s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:40 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e is being set with open permissions: ugo+rw Jul 07 09:22:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:40 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e Jul 07 09:22:40 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:41 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e" returned: 0 in 0.669s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.495s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-19e28d05-a40b-4ea6-87db-8887ffe91bd9 tempest-SnapshotsActionsTest-1388511838 None] Create snapshot completed successfully Jul 07 09:22:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-d0d3cf24-7c07-47a4-ab47-5c305c533a7e-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-d0d3cf24-7c07-47a4-ab47-5c305c533a7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Acquiring lock "cinder-quobyte-d0d3cf24-7c07-47a4-ab47-5c305c533a7e" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-d0d3cf24-7c07-47a4-ab47-5c305c533a7e" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Deleting offline snapshot d0d3cf24-7c07-47a4-ab47-5c305c533a7e of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] snapshot_file for this snap is: volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[438cbd15-693b-4af7-97b4-e3ec171fc53f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:42 devstack sudo[99745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e Jul 07 09:22:42 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:43 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e" returned: 0 in 1.050s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f47912-c876-4fba-a49e-80acdf439e26]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:43 devstack sudo[99757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:43 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:44 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 1.029s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:44 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e Jul 07 09:22:44 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:45 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e" returned: 0 in 0.825s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:45 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e Jul 07 09:22:45 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:45 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.d0d3cf24-7c07-47a4-ab47-5c305c533a7e" returned: 0 in 0.715s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-d0d3cf24-7c07-47a4-ab47-5c305c533a7e" released by "_delete_snapshot" :: held 3.748s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" released by "delete_snapshot" :: held 3.781s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Created reservations ['1c236c56-3598-4d1c-8ac5-78736d547a00', '294c8967-c8c5-4b1b-a741-9722bfbbbd84', 'af844ef4-cd48-42fd-88ad-bc57ddfb9ce1', '2272b763-79bf-48d7-9efe-a67f7e000d4c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Delete snapshot completed successfully. Jul 07 09:22:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed60796b-7f29-4b72-8761-6dbbfb4718ab tempest-SnapshotsActionsTest-1510084996 None] Lock "cinder-d0d3cf24-7c07-47a4-ab47-5c305c533a7e-delete_snapshot" released by "delete_snapshot" :: held 3.947s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "cinder-211bf0a3-ac9e-48b2-a65e-1acc14f2f68e-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-211bf0a3-ac9e-48b2-a65e-1acc14f2f68e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "cinder-quobyte-211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-quobyte-211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Deleting offline snapshot 211bf0a3-ac9e-48b2-a65e-1acc14f2f68e of volume 29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] snapshot_file for this snap is: volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0519773-431c-4772-8f62-cce13311abfe]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:46 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:46 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:47 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.797s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29698aff-73ba-4ab0-895c-da210732101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:22:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e5b0ad-e02c-474a-831c-56047bf25c8d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:47 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b Jul 07 09:22:47 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:48 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b" returned: 0 in 0.976s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "cinder-30e40b42-5f4d-409f-b63f-5c56ad1be9c4-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:48 devstack sudo[99788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:48 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-30e40b42-5f4d-409f-b63f-5c56ad1be9c4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "cinder-quobyte-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-quobyte-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af6f4fc-700c-4570-9b9a-0de2e96898d2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:48 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 Jul 07 09:22:48 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:49 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" returned: 0 in 0.844s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:49 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 1.008s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:49 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4 Jul 07 09:22:49 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:49 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e Jul 07 09:22:49 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:50 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" returned: 0 in 0.802s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-quobyte-30e40b42-5f4d-409f-b63f-5c56ad1be9c4" released by "delete_volume" :: held 1.702s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=135,cinder:INSERT=43,cinder:UPDATE=163,cinder:DELETE=15 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:22:50 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b.211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" returned: 0 in 0.835s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-quobyte-211bf0a3-ac9e-48b2-a65e-1acc14f2f68e" released by "_delete_snapshot" :: held 3.764s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" released by "delete_snapshot" :: held 3.791s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Created reservations ['f2fe29b7-ffe0-4f50-855d-ef804e914f74', 'b0c85001-7c8b-49fa-94d9-266132cf9796', 'bf860ed7-412e-4c2c-bbc3-e74ac94864f3', 'ec77ebe1-7cea-4b2f-92cf-f404abc8fbe0'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Created reservations ['24526eba-2bfd-4073-b323-b35f0b102f35', '992e837c-6b08-4aec-97cf-0dab5b84f18e', '817541a1-d773-4ffd-875f-ce0784c1aecd', '8062202b-4460-4150-a656-81868c846538'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:50 devstack sudo[99806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:50 devstack sudo[99806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Delete snapshot completed successfully. Jul 07 09:22:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f0ab13-7f7a-4631-930d-615ca25eaf1f tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-211bf0a3-ac9e-48b2-a65e-1acc14f2f68e-delete_snapshot" released by "delete_snapshot" :: held 4.043s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "cinder-428642ef-061d-4277-970d-de714024ab10-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-428642ef-061d-4277-970d-de714024ab10-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "cinder-29698aff-73ba-4ab0-895c-da210732101b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "cinder-quobyte-428642ef-061d-4277-970d-de714024ab10" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-29698aff-73ba-4ab0-895c-da210732101b-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-quobyte-428642ef-061d-4277-970d-de714024ab10" acquired by "delete_volume" :: waited 0.047s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6039951d-6d9f-465b-86be-a3bd39dd820e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" acquired by "delete_volume" :: waited 0.072s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e42f71f-f6ec-4632-a965-51940b754ccc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:51 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 Jul 07 09:22:51 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:51 devstack sudo[99806]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.838s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Deleted volume successfully. Jul 07 09:22:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d618f40-e751-4619-8bba-3213aabe24c3 tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-30e40b42-5f4d-409f-b63f-5c56ad1be9c4-delete_volume" released by "delete_volume" :: held 2.899s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:51 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b Jul 07 09:22:51 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:52 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10" returned: 0 in 0.885s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:52 devstack sudo[99820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10 Jul 07 09:22:52 devstack sudo[99820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:52 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:52 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b Jul 07 09:22:52 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:52 devstack sudo[99820]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-428642ef-061d-4277-970d-de714024ab10" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-quobyte-428642ef-061d-4277-970d-de714024ab10" released by "delete_volume" :: held 1.745s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:52 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-29698aff-73ba-4ab0-895c-da210732101b" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-quobyte-29698aff-73ba-4ab0-895c-da210732101b" released by "delete_volume" :: held 1.666s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Created reservations ['60b29f77-ab0e-4696-8b79-c2ddb539c02c', '7aa44ca5-bf73-4c80-a239-b3624ded4997', '0a3b1962-9adf-4dda-8d78-8b452697c3c4', '92cdeedd-ace6-496a-bfab-4e0112ada221'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Created reservations ['34376907-70e1-4815-9798-2879f505681b', '7c8f6f7c-795f-407b-8227-3de589528a9f', '375e223d-202d-4a01-9fbc-bd23d7aeac2b', '30adf6dc-c871-47ed-af5e-c6131780019c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:53 devstack sudo[99826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:53 devstack sudo[99826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:53 devstack sudo[99828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:22:53 devstack sudo[99828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:54 devstack sudo[99828]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.787s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Deleted volume successfully. Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c931a724-431a-40b1-a108-3398d53840fc tempest-SnapshotsActionsTest-1388511838 None] Lock "cinder-29698aff-73ba-4ab0-895c-da210732101b-delete_volume" released by "delete_volume" :: held 2.943s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:54 devstack sudo[99826]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.074s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:22:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Deleted volume successfully. Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b5796e66-46e9-4103-821c-0dfc0f9f82fe tempest-TestServerVolumeAttachmentScenario-1210504325 None] Lock "cinder-428642ef-061d-4277-970d-de714024ab10-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Flow 'volume_create_manager' (ba628e2a-7598-4ead-9cf7-489f47e8e1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42f0210-6067-4b0a-95da-1a55494e1e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f42f0210-6067-4b0a-95da-1a55494e1e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2129820785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58fe54a-063c-4aac-99dd-1651979c66f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6e66118e7345f0977a7389e5f42676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:54Z,use_quota=True,user_id='a5869897447e40199f285d9b343201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0c68a7-e6bd-4646-835f-d829342c6d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec0c68a7-e6bd-4646-835f-d829342c6d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c30125-11d3-4da7-ab31-b830ffa5a1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c30125-11d3-4da7-ab31-b830ffa5a1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58fe54a-063c-4aac-99dd-1651979c66f6', 'volume_name': 'volume-c58fe54a-063c-4aac-99dd-1651979c66f6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f396c8-7cc9-4ae2-8a92-e413618bdc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f396c8-7cc9-4ae2-8a92-e413618bdc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7526444a-9ce0-48cc-8d2f-4ee0115b7d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Volume c58fe54a-063c-4aac-99dd-1651979c66f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58fe54a-063c-4aac-99dd-1651979c66f6', 'volume_size': 1} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:22:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2129820785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58fe54a-063c-4aac-99dd-1651979c66f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef6e66118e7345f0977a7389e5f42676',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:22:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:22:54Z,use_quota=True,user_id='a5869897447e40199f285d9b343201bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Creating volume c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:22:54 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:22:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:54 devstack sudo[99832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 1073741824 Jul 07 09:22:54 devstack sudo[99832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:55 devstack sudo[99832]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 1073741824" returned: 0 in 0.969s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:22:55 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:22:55 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:22:56 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.750s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.772s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7526444a-9ce0-48cc-8d2f-4ee0115b7d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58fe54a-063c-4aac-99dd-1651979c66f6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab733cf-90ac-4aef-a78e-5bedfecca81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:22:56 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Volume volume-c58fe54a-063c-4aac-99dd-1651979c66f6 (c58fe54a-063c-4aac-99dd-1651979c66f6): created successfully Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab733cf-90ac-4aef-a78e-5bedfecca81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:22:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Flow 'volume_create_manager' (ba628e2a-7598-4ead-9cf7-489f47e8e1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:22:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-dc1ee71a-452b-44c4-a74e-1bc8a9f0edb8 tempest-VolumesActionsTest-739177780 None] Created volume successfully. Jul 07 09:23:06 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=19,cinder:INSERT=10,cinder:UPDATE=37 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:23:06 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:INSERT=30,cinder:UPDATE=106,cinder:SELECT=85,cinder:DELETE=12 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:23:10 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Flow 'volume_create_manager' (0a398ddb-c0f9-4394-9d84-8142a9d7e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a87dca-c65f-4b81-ac0f-5e4c1d40c987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59a87dca-c65f-4b81-ac0f-5e4c1d40c987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1862831326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0475a7-6737-4804-9178-519e5d5e14b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04d07d942ce4bdeb8c652a37fd4d4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:11Z,use_quota=True,user_id='99d7ca08f22d464aae155a96160a433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cb7d44-e45a-4c17-82cd-3f1f7c4ac894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49cb7d44-e45a-4c17-82cd-3f1f7c4ac894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5e0c15-de48-49e0-8956-8bb71c9f6fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b5e0c15-de48-49e0-8956-8bb71c9f6fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0475a7-6737-4804-9178-519e5d5e14b8', 'volume_name': 'volume-8f0475a7-6737-4804-9178-519e5d5e14b8', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56351b6f-b0e2-43cb-aedc-a2d8c3e97b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56351b6f-b0e2-43cb-aedc-a2d8c3e97b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcbca15-828b-452f-a628-f0026f952850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Volume 8f0475a7-6737-4804-9178-519e5d5e14b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0475a7-6737-4804-9178-519e5d5e14b8', 'volume_size': 1} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1862831326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0475a7-6737-4804-9178-519e5d5e14b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04d07d942ce4bdeb8c652a37fd4d4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:11Z,use_quota=True,user_id='99d7ca08f22d464aae155a96160a433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Creating volume 8f0475a7-6737-4804-9178-519e5d5e14b8 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:11 devstack sudo[99934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 1073741824 Jul 07 09:23:11 devstack sudo[99934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:12 devstack sudo[99934]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 1073741824" returned: 0 in 1.247s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:12 devstack sudo[99943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 Jul 07 09:23:12 devstack sudo[99943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:13 devstack sudo[99943]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8" returned: 0 in 0.993s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] <== create_volume: return (2297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.301s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bcbca15-828b-452f-a628-f0026f952850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0475a7-6737-4804-9178-519e5d5e14b8', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6345ec36-a314-4337-8fa7-8b82ee23c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Volume volume-8f0475a7-6737-4804-9178-519e5d5e14b8 (8f0475a7-6737-4804-9178-519e5d5e14b8): created successfully Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6345ec36-a314-4337-8fa7-8b82ee23c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Flow 'volume_create_manager' (0a398ddb-c0f9-4394-9d84-8142a9d7e065) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7e8d942c-bbc8-48d5-983a-e4f2b4c9c24f tempest-VolumeQuotasAdminTestJSON-761306597 None] Created volume successfully. Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-aedda0c4-67df-4750-ba16-b88f8724ec5d tempest-VolumesActionsTest-739177780 None] Acquiring lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6" by "attach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "cinder-8f0475a7-6737-4804-9178-519e5d5e14b8-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-aedda0c4-67df-4750-ba16-b88f8724ec5d tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6" acquired by "attach_volume" :: waited 0.044s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "cinder-8f0475a7-6737-4804-9178-519e5d5e14b8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "cinder-quobyte-8f0475a7-6737-4804-9178-519e5d5e14b8" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-aedda0c4-67df-4750-ba16-b88f8724ec5d tempest-VolumesActionsTest-739177780 None] Attaching volume c58fe54a-063c-4aac-99dd-1651979c66f6 to instance 9b21dd12-60b7-49ed-97e4-d46e413f888c at mountpoint /dev/vdb on host None. Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "cinder-quobyte-8f0475a7-6737-4804-9178-519e5d5e14b8" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-aedda0c4-67df-4750-ba16-b88f8724ec5d tempest-VolumesActionsTest-739177780 None] Attach volume completed successfully. Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d344cd-b6e6-4843-a706-e3c9efcda268]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-aedda0c4-67df-4750-ba16-b88f8724ec5d tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6" released by "attach_volume" :: held 0.177s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:14 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 Jul 07 09:23:14 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47ef7c67-58aa-4ec8-8268-6615a00d1992 tempest-VolumesActionsTest-739177780 None] Acquiring lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-detach_volume" by "detach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47ef7c67-58aa-4ec8-8268-6615a00d1992 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-47ef7c67-58aa-4ec8-8268-6615a00d1992 tempest-VolumesActionsTest-739177780 None] Detaching volume c58fe54a-063c-4aac-99dd-1651979c66f6 from instance 9b21dd12-60b7-49ed-97e4-d46e413f888c. Jul 07 09:23:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-47ef7c67-58aa-4ec8-8268-6615a00d1992 tempest-VolumesActionsTest-739177780 None] Detach volume completed successfully. Jul 07 09:23:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47ef7c67-58aa-4ec8-8268-6615a00d1992 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-detach_volume" released by "detach_volume" :: held 0.131s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:15 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8" returned: 0 in 0.964s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:15 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8 Jul 07 09:23:15 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:16 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f0475a7-6737-4804-9178-519e5d5e14b8" returned: 0 in 1.039s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "cinder-quobyte-8f0475a7-6737-4804-9178-519e5d5e14b8" released by "delete_volume" :: held 2.057s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Created reservations ['87807d76-85b0-4baf-a1b8-5b0c293b238c', '92748178-3f4b-4ce7-92d5-6f407f54f8ee', 'c1e6b8ee-dec4-4e56-8a8d-21872d295df5', '6a2f3dff-783a-4847-907e-2cf0073a16e8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:16 devstack sudo[99956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:23:16 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:17 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.686s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:17 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:23:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Deleted volume successfully. Jul 07 09:23:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ceaf12d4-d9c7-4ea8-becf-72bf55d707ad tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "cinder-8f0475a7-6737-4804-9178-519e5d5e14b8-delete_volume" released by "delete_volume" :: held 3.029s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Flow 'volume_create_manager' (a3e46dcb-8eba-4c6e-9455-c894ce9b2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1359e6d7-8df9-4e97-8ecb-a324ea770784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1359e6d7-8df9-4e97-8ecb-a324ea770784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2092931807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e879315-2bea-4c07-84c1-adcd7a3bb3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04d07d942ce4bdeb8c652a37fd4d4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:18Z,use_quota=True,user_id='99d7ca08f22d464aae155a96160a433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c378b3-1700-4ccb-a9f3-df78c5855bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c378b3-1700-4ccb-a9f3-df78c5855bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e9d0f9-fcbc-4fab-8c53-60ea015cd821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e9d0f9-fcbc-4fab-8c53-60ea015cd821) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e879315-2bea-4c07-84c1-adcd7a3bb3b9', 'volume_name': 'volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5577e378-7079-4a80-b989-1ee53ba05e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5577e378-7079-4a80-b989-1ee53ba05e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd6cb8d-1586-430b-b4c6-54853b60fa40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Volume 9e879315-2bea-4c07-84c1-adcd7a3bb3b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9', 'volume_size': 1} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2092931807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e879315-2bea-4c07-84c1-adcd7a3bb3b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a04d07d942ce4bdeb8c652a37fd4d4b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:18Z,use_quota=True,user_id='99d7ca08f22d464aae155a96160a433c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Creating volume 9e879315-2bea-4c07-84c1-adcd7a3bb3b9 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:18 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:18 devstack sudo[99981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 1073741824 Jul 07 09:23:18 devstack sudo[99981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:19 devstack sudo[99981]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 1073741824" returned: 0 in 0.996s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:19 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 Jul 07 09:23:19 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:20 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9" returned: 0 in 0.664s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd6cb8d-1586-430b-b4c6-54853b60fa40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3c45f6-e3ba-42a7-a94e-58c4eba4dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Volume volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 (9e879315-2bea-4c07-84c1-adcd7a3bb3b9): created successfully Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a3c45f6-e3ba-42a7-a94e-58c4eba4dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Flow 'volume_create_manager' (a3e46dcb-8eba-4c6e-9455-c894ce9b2447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7f93cde1-73c9-4d8c-8e7d-95d3288ad588 tempest-VolumeQuotasAdminTestJSON-761306597 None] Created volume successfully. Jul 07 09:23:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-33ae43db-43d9-4adc-b1cd-dca8a52194c6 tempest-VolumeQuotasAdminTestJSON-920058082 None] Transfer volume completed successfully. Jul 07 09:23:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Acquiring lock "cinder-9e879315-2bea-4c07-84c1-adcd7a3bb3b9-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Lock "cinder-9e879315-2bea-4c07-84c1-adcd7a3bb3b9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Acquiring lock "cinder-quobyte-9e879315-2bea-4c07-84c1-adcd7a3bb3b9" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Lock "cinder-quobyte-9e879315-2bea-4c07-84c1-adcd7a3bb3b9" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:22 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3755cb6e-a8c2-4fab-ad39-38992adec8df]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:22 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 Jul 07 09:23:22 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:23 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9" returned: 0 in 0.890s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:23 devstack sudo[99997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9 Jul 07 09:23:23 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:24 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9e879315-2bea-4c07-84c1-adcd7a3bb3b9" returned: 0 in 0.790s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Lock "cinder-quobyte-9e879315-2bea-4c07-84c1-adcd7a3bb3b9" released by "delete_volume" :: held 1.733s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Created reservations ['5ff97877-8a90-447f-a3ac-2437c22da095', 'c45d3462-d05c-40b3-aa9a-4c3652baeac5', '1bde76b2-34da-45de-addb-e660dcf90813', 'fa013072-0d12-43df-954f-6d7a93531641'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:24 devstack sudo[100000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:23:24 devstack sudo[100000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:25 devstack sudo[100000]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.830s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:25 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:23:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Deleted volume successfully. Jul 07 09:23:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3fb1c82-c085-497e-a587-b70943f4e07f tempest-VolumeQuotasAdminTestJSON-1151308007 None] Lock "cinder-9e879315-2bea-4c07-84c1-adcd7a3bb3b9-delete_volume" released by "delete_volume" :: held 2.848s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:27 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:23:27 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:27 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.838s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:23:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:23:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:23:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Flow 'volume_create_manager' (ef0dd2ab-83ee-4bd4-8ef0-8eb3f3e177a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc280be-5022-4b05-806b-1c1acb784e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccc280be-5022-4b05-806b-1c1acb784e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-922639856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebd8b36-6707-444a-a279-8ce7e8adfb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3faae1f1348bb802cbf89a9e0a2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:30Z,use_quota=True,user_id='d4aa4f631a4e435ab26ec3677f0e2263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb8e275-2cd7-485e-9ef2-cbfc44fc86aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4cb8e275-2cd7-485e-9ef2-cbfc44fc86aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dd528e-af7b-4c30-a45f-c0f207099080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80dd528e-af7b-4c30-a45f-c0f207099080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ebd8b36-6707-444a-a279-8ce7e8adfb57', 'volume_name': 'volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc47fa1-b803-48be-a236-92e59fd3e1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc47fa1-b803-48be-a236-92e59fd3e1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8682787-848c-4233-b850-916b4f550f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:30 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Volume 7ebd8b36-6707-444a-a279-8ce7e8adfb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57', 'volume_size': 1} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-922639856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ebd8b36-6707-444a-a279-8ce7e8adfb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3faae1f1348bb802cbf89a9e0a2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:30Z,use_quota=True,user_id='d4aa4f631a4e435ab26ec3677f0e2263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Creating volume 7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:30 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:30 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 1073741824 Jul 07 09:23:30 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:31 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 1073741824" returned: 0 in 1.251s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:31 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:23:31 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:32 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 0.861s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] <== create_volume: return (2190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.192s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8682787-848c-4233-b850-916b4f550f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f48f26-b9b5-4fe5-ba0f-71fd217a90e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:32 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Volume volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 (7ebd8b36-6707-444a-a279-8ce7e8adfb57): created successfully Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f48f26-b9b5-4fe5-ba0f-71fd217a90e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Flow 'volume_create_manager' (ef0dd2ab-83ee-4bd4-8ef0-8eb3f3e177a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-72ed64ec-30e0-46f1-85aa-bf4aae80ac21 tempest-TestStampPattern-1907711172 None] Created volume successfully. Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Flow 'volume_create_manager' (52240a21-220c-4b3a-8baf-2d6565c52056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292e0889-a54a-45b4-bdc0-1a5a3b7f4c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292e0889-a54a-45b4-bdc0-1a5a3b7f4c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952090366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f8ba5559f64510a20f6abf9f2c03d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:40Z,use_quota=True,user_id='97d6acc7141b461e8d1681da6fb6cec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52ac492-8242-4941-b654-c8e4e584b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52ac492-8242-4941-b654-c8e4e584b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e239789f-105e-4f65-a770-fe8b8ddd4091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e239789f-105e-4f65-a770-fe8b8ddd4091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb', 'volume_name': 'volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a947f4cd-5fe6-4707-8623-c0972ec69932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a947f4cd-5fe6-4707-8623-c0972ec69932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b65ec5-ed53-4fb5-b7e3-f8b2bfd896c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:40 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Volume bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb', 'volume_size': 1} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-952090366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f8ba5559f64510a20f6abf9f2c03d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:40Z,use_quota=True,user_id='97d6acc7141b461e8d1681da6fb6cec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Creating volume bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:40 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:40 devstack sudo[100168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb 1073741824 Jul 07 09:23:40 devstack sudo[100168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1cfe6c51-ddeb-4bb3-88b0-bb730e15b3a2 tempest-VolumesActionsTest-739177780 None] Acquiring lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6" by "attach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1cfe6c51-ddeb-4bb3-88b0-bb730e15b3a2 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6" acquired by "attach_volume" :: waited 0.036s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1cfe6c51-ddeb-4bb3-88b0-bb730e15b3a2 tempest-VolumesActionsTest-739177780 None] Attaching volume c58fe54a-063c-4aac-99dd-1651979c66f6 to instance 7c1e95b0-6273-4676-9f37-855c3ec1e211 at mountpoint /dev/vdb on host None. Jul 07 09:23:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1cfe6c51-ddeb-4bb3-88b0-bb730e15b3a2 tempest-VolumesActionsTest-739177780 None] Attach volume completed successfully. Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1cfe6c51-ddeb-4bb3-88b0-bb730e15b3a2 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6" released by "attach_volume" :: held 0.156s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:41 devstack sudo[100168]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb 1073741824" returned: 0 in 1.108s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:41 devstack sudo[100175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb Jul 07 09:23:41 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-88879209-b806-47e9-a153-7fcb8755a7b3 tempest-VolumesActionsTest-739177780 None] Acquiring lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-detach_volume" by "detach_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-88879209-b806-47e9-a153-7fcb8755a7b3 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-88879209-b806-47e9-a153-7fcb8755a7b3 tempest-VolumesActionsTest-739177780 None] Detaching volume c58fe54a-063c-4aac-99dd-1651979c66f6 from instance 7c1e95b0-6273-4676-9f37-855c3ec1e211. Jul 07 09:23:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-88879209-b806-47e9-a153-7fcb8755a7b3 tempest-VolumesActionsTest-739177780 None] Detach volume completed successfully. Jul 07 09:23:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-88879209-b806-47e9-a153-7fcb8755a7b3 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:42 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb" returned: 0 in 0.712s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7b65ec5-ed53-4fb5-b7e3-f8b2bfd896c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73299201-10a1-4f1b-a96f-a9b8a892bdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:42 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Volume volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb (bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb): created successfully Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73299201-10a1-4f1b-a96f-a9b8a892bdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Flow 'volume_create_manager' (52240a21-220c-4b3a-8baf-2d6565c52056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8dae7097-15f2-4beb-9e85-0a611a7f0f58 tempest-VolumesListAdminTestJSON-1166747758 None] Created volume successfully. Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Flow 'volume_create_manager' (79955776-840c-4468-9809-ffafbbd35f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c6caac-82ed-4a7e-a6d7-485b3609bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00c6caac-82ed-4a7e-a6d7-485b3609bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-234027003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba21b6f2-d401-46bd-b5ff-9ac141fa4af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f8ba5559f64510a20f6abf9f2c03d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:44Z,use_quota=True,user_id='97d6acc7141b461e8d1681da6fb6cec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b0a37-1126-4701-a5a8-20a610a59606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4b0a37-1126-4701-a5a8-20a610a59606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ecc0a3-8720-4501-b745-e602055097d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23ecc0a3-8720-4501-b745-e602055097d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba21b6f2-d401-46bd-b5ff-9ac141fa4af2', 'volume_name': 'volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab8e0ad-ea04-4cb1-a158-069eb95d19a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ab8e0ad-ea04-4cb1-a158-069eb95d19a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f4759e-9096-4826-9c50-0d560d0aa672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:44 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Volume ba21b6f2-d401-46bd-b5ff-9ac141fa4af2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2', 'volume_size': 1} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-234027003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba21b6f2-d401-46bd-b5ff-9ac141fa4af2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f8ba5559f64510a20f6abf9f2c03d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:44Z,use_quota=True,user_id='97d6acc7141b461e8d1681da6fb6cec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Creating volume ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:44 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:44 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 1073741824 Jul 07 09:23:44 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:45 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 1073741824" returned: 0 in 1.323s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:45 devstack sudo[100251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 Jul 07 09:23:45 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:46 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.147s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37f4759e-9096-4826-9c50-0d560d0aa672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9010b729-7d41-44cb-9469-d8d51dc847d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Volume volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 (ba21b6f2-d401-46bd-b5ff-9ac141fa4af2): created successfully Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9010b729-7d41-44cb-9469-d8d51dc847d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Flow 'volume_create_manager' (79955776-840c-4468-9809-ffafbbd35f3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a045a157-c212-47fd-8dcd-286d0a4e3ad8 tempest-VolumesListAdminTestJSON-1166747758 None] Created volume successfully. Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Flow 'volume_create_manager' (ec9a5cf1-956f-42c6-84e5-f07e46410df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b99de1-3e93-4d19-a7bc-8b71507eb58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b99de1-3e93-4d19-a7bc-8b71507eb58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1327975310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d5145d-9f8c-4a8e-9cc8-8cfec40483fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f8ba5559f64510a20f6abf9f2c03d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:48Z,use_quota=True,user_id='97d6acc7141b461e8d1681da6fb6cec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549f4997-d9c5-4b92-a668-22aa885114ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (549f4997-d9c5-4b92-a668-22aa885114ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ad41ff-0473-4ba3-ab53-2b424ed3766f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ad41ff-0473-4ba3-ab53-2b424ed3766f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68d5145d-9f8c-4a8e-9cc8-8cfec40483fc', 'volume_name': 'volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c770db-b1db-40dc-84cc-5d0060e62a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73c770db-b1db-40dc-84cc-5d0060e62a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6147648b-86de-45bd-81d0-ec5b85175ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Volume 68d5145d-9f8c-4a8e-9cc8-8cfec40483fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc', 'volume_size': 1} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1327975310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68d5145d-9f8c-4a8e-9cc8-8cfec40483fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7f8ba5559f64510a20f6abf9f2c03d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:48Z,use_quota=True,user_id='97d6acc7141b461e8d1681da6fb6cec1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Creating volume 68d5145d-9f8c-4a8e-9cc8-8cfec40483fc {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:47 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:47 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc 1073741824 Jul 07 09:23:47 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:48 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc 1073741824" returned: 0 in 0.911s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:48 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc Jul 07 09:23:48 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:49 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc" returned: 0 in 0.764s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] <== create_volume: return (1773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6147648b-86de-45bd-81d0-ec5b85175ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a428bb-3cdb-49ca-aff0-f7efbb8dc1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:49 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Volume volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc (68d5145d-9f8c-4a8e-9cc8-8cfec40483fc): created successfully Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96a428bb-3cdb-49ca-aff0-f7efbb8dc1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Flow 'volume_create_manager' (ec9a5cf1-956f-42c6-84e5-f07e46410df3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cfa57291-0686-4559-b1c9-5d4e937d07a9 tempest-VolumesListAdminTestJSON-1166747758 None] Created volume successfully. Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Flow 'volume_create_manager' (03411f05-0225-4993-bafa-d8bc0aa23942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451c7d07-5d46-49d0-ac9f-1cb8962e3a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451c7d07-5d46-49d0-ac9f-1cb8962e3a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b3be98-cc8f-474f-bda5-ddffbb2cc6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64196762e9bc45a382e48388d213bdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:50Z,use_quota=True,user_id='92742163e8f34588bd5cd0654b2d1039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c075ded-0c34-4690-8bac-5a7c2966f3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c075ded-0c34-4690-8bac-5a7c2966f3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489a6d68-be00-4344-9686-5a0ad484455b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489a6d68-be00-4344-9686-5a0ad484455b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90b3be98-cc8f-474f-bda5-ddffbb2cc6f7', 'volume_name': 'volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7235b813-01cd-4736-a4ba-7a7290481461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7235b813-01cd-4736-a4ba-7a7290481461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bc5530-97ef-41e6-b8d3-d566e13e9da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Volume 90b3be98-cc8f-474f-bda5-ddffbb2cc6f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7', 'volume_size': 1} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90b3be98-cc8f-474f-bda5-ddffbb2cc6f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64196762e9bc45a382e48388d213bdf9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:23:50Z,use_quota=True,user_id='92742163e8f34588bd5cd0654b2d1039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Creating volume 90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:23:50 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:23:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:50 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 1073741824 Jul 07 09:23:50 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:51 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 1073741824" returned: 0 in 1.048s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:51 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 Jul 07 09:23:51 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:52 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7" returned: 0 in 0.803s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.118s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bc5530-97ef-41e6-b8d3-d566e13e9da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8168e442-7f7f-44b4-a066-896bb6ff1647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a841f452-6d38-4af2-a84e-4481b1695f6b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:52 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Volume volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 (90b3be98-cc8f-474f-bda5-ddffbb2cc6f7): created successfully Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8168e442-7f7f-44b4-a066-896bb6ff1647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:23:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Flow 'volume_create_manager' (03411f05-0225-4993-bafa-d8bc0aa23942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:23:52 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-010b99e6-adf7-44a0-92de-88c9cc250a6a tempest-VolumesListAdminTestJSON-1663582972 None] Created volume successfully. Jul 07 09:23:52 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:23:52 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:53 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.793s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f3fa34-d8b0-49d0-98bc-78f18a7b842b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:53 devstack sudo[100310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:23:53 devstack sudo[100310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Acquiring lock "cinder-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Lock "cinder-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Acquiring lock "cinder-quobyte-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Lock "cinder-quobyte-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7" acquired by "delete_volume" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd32db8-a03a-4790-a107-da75a2005dcb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "cinder-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "cinder-quobyte-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-quobyte-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c70033-a7fe-411c-b90f-be1b2432177a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:54 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 Jul 07 09:23:54 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:54 devstack sudo[100313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc Jul 07 09:23:54 devstack sudo[100313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:54 devstack sudo[100310]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.888s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.dc33ffbd-9ab2-45a8-9823-0da0008c37232zmh7mk2.img {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:54 devstack sudo[100320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.dc33ffbd-9ab2-45a8-9823-0da0008c37232zmh7mk2.img Jul 07 09:23:54 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:54 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7" returned: 0 in 0.951s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:54 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7 Jul 07 09:23:54 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:55 devstack sudo[100313]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc" returned: 0 in 1.057s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:55 devstack sudo[100334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc Jul 07 09:23:55 devstack sudo[100334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:56 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7" returned: 0 in 1.648s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Lock "cinder-quobyte-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7" released by "delete_volume" :: held 2.709s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:56 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Created reservations ['b8485291-66c7-4dfb-8390-270a82699d71', '09b04203-edbe-42a1-bd3a-e0ba58b602a0', 'c385e895-b491-4cec-a74b-8fbf59503724', 'cd5ee848-87c2-4535-aa9e-3cb0d971cfa1'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:57 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:23:57 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:57 devstack sudo[100334]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc" returned: 0 in 2.080s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-quobyte-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc" released by "delete_volume" :: held 3.231s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Created reservations ['1c8b138d-9a6f-4ddc-92d4-568198a3b5f0', 'b8737609-d6e5-43f0-8f60-5197e7717cc3', 'd07f86fb-37e8-4f21-9152-a1ff0a3973b5', '34dd8438-d6b0-4487-8a0b-c050c2624416'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:23:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:58 devstack sudo[100349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:23:58 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:23:59 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.988s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:23:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Deleted volume successfully. Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "cinder-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e8c7aea8-deeb-4661-938a-1dc17c92b9d6 tempest-VolumesListAdminTestJSON-1663582972 None] Lock "cinder-90b3be98-cc8f-474f-bda5-ddffbb2cc6f7-delete_volume" released by "delete_volume" :: held 5.450s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "cinder-quobyte-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-quobyte-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2" acquired by "delete_volume" :: waited 0.043s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8319528b-c2cb-4e2b-951d-149730856ab2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:23:59 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.604s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:23:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Deleted volume successfully. Jul 07 09:23:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b06ba6-428f-439b-92b4-cfa287d2a8ec tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-68d5145d-9f8c-4a8e-9cc8-8cfec40483fc-delete_volume" released by "delete_volume" :: held 5.581s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:23:59 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 Jul 07 09:23:59 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:00 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2" returned: 0 in 1.446s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:00 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2 Jul 07 09:24:00 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:00 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.dc33ffbd-9ab2-45a8-9823-0da0008c37232zmh7mk2.img" returned: 0 in 6.665s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:00 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[918c25f0-2f81-4c6f-b40e-9ecfc2071064]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:01 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:24:01 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:01 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2" returned: 0 in 0.640s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-quobyte-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2" released by "delete_volume" :: held 2.167s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Created reservations ['663ad136-1cd1-436e-9a07-a1dbf8999485', 'fd8e00d3-f125-4a51-8076-b59ca4ac1f8d', '294286b1-5eb6-4142-8ae7-a9dffc4877dc', 'd1a01afd-9b28-49f5-9319-99ba7ef08862'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:01 devstack sudo[100394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:01 devstack sudo[100394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:01 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.945s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6, size 1024.00 MB, duration 6.67 sec, destination /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.dc33ffbd-9ab2-45a8-9823-0da0008c37232zmh7mk2.img {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:24:01 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Converted 1024.00 MB image at 153.62 MB/s Jul 07 09:24:01 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] dc33ffbd-9ab2-45a8-9823-0da0008c3723 was raw, no need to convert to raw {{(pid=86769) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 07 09:24:02 devstack sudo[100394]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.658s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:02 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Deleted volume successfully. Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-30b3658e-d8c1-4bd9-9c9e-179a6983c009 tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-ba21b6f2-d401-46bd-b5ff-9ac141fa4af2-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "cinder-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "cinder-quobyte-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-quobyte-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a448c4d0-6aeb-4c61-a00f-895ee8bd4ed2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:02 devstack sudo[100398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb Jul 07 09:24:02 devstack sudo[100398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:03 devstack sudo[100398]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb" returned: 0 in 0.770s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:03 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb Jul 07 09:24:03 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:04 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb" returned: 0 in 0.655s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-quobyte-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb" released by "delete_volume" :: held 1.468s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Created reservations ['657805d3-24de-48fd-a126-bfe5c0295899', '49fe7d3b-cc6c-489b-bc5b-042f4de0ccad', 'b3d17015-ed80-4455-bc54-c3f7b7b3de91', '0a9db3f3-c3f0-472c-a745-b8f182b3a8c4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:04 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:04 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:05 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.692s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:05 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:05 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Deleted volume successfully. Jul 07 09:24:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ac01a3f6-c447-4746-a312-2f1503841bca tempest-VolumesListAdminTestJSON-1166747758 None] Lock "cinder-bc5ae028-9dd5-4d3d-ae79-ec01c8cd79eb-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=64,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=16 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=76,cinder:SELECT=56,cinder:INSERT=19,cinder:DELETE=6 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Flow 'volume_create_manager' (ce18bfa3-02ec-43d3-8127-9f955c2e9610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7507651b-a334-4365-8a19-32a00a8533e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7507651b-a334-4365-8a19-32a00a8533e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-580072875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4830cecf-ea8d-4fd6-8e0e-f4a94955e885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265dfa1326204b71aae26383cc00ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:12Z,use_quota=True,user_id='0ea84d2ef17b4d0dbc5b60583849807b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3acca2-b81d-4ccb-a1d8-3e31b7de5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3acca2-b81d-4ccb-a1d8-3e31b7de5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c3888f-f459-47c7-8edd-bf8adba85a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5c3888f-f459-47c7-8edd-bf8adba85a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4830cecf-ea8d-4fd6-8e0e-f4a94955e885', 'volume_name': 'volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e620a35-3444-46e6-9af3-b5d7c50e34ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e620a35-3444-46e6-9af3-b5d7c50e34ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caccb18-f166-4045-97b9-d577bd7db84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Volume 4830cecf-ea8d-4fd6-8e0e-f4a94955e885: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 09:24:12 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Trying to clone 4830cecf-ea8d-4fd6-8e0e-f4a94955e885 from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:24:13 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:24:13 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Image download 20.69 MB at 20.69 MB/s Jul 07 09:24:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e98ad-948f-43c2-9c3e-3822f41550a0]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:13 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD Jul 07 09:24:13 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:14 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:14 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 is fetched for user 0ea84d2ef17b4d0dbc5b60583849807b. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:24:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3774f6-d313-45f3-8598-4fa2c21f198b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:14 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD Jul 07 09:24:14 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:15 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.842s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Uploaded volume to glance image-id: dc33ffbd-9ab2-45a8-9823-0da0008c3723. {{(pid=86769) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.430s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-580072875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4830cecf-ea8d-4fd6-8e0e-f4a94955e885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='265dfa1326204b71aae26383cc00ecdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:12Z,use_quota=True,user_id='0ea84d2ef17b4d0dbc5b60583849807b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Creating volume 4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:24:22 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:24:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:22 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 1073741824 Jul 07 09:24:22 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-74ed1419-65e7-4b41-a0a7-665ca2e54e48 tempest-VolumesActionsTest-739177780 None] Copy volume to image completed successfully. Jul 07 09:24:23 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 1073741824" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:23 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:23 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:23 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 0 in 0.653s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.649s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1728a04b-b194-4aad-87cb-ec601caf8456]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Attempting download of 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume 4830cecf-ea8d-4fd6-8e0e-f4a94955e885. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2615c0-1d84-4ae7-8367-6657e6743e18]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:24 devstack sudo[100451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:24:24 devstack sudo[100451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:24 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9 Jul 07 09:24:24 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:24 devstack sudo[100451]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 0.775s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.797s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:24 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.032s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9" returned: 0 in 0.727s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1350824-52b4-4964-91e5-6124a2f6ae49]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '91b37a86-e676-4ad1-8cc8-13aad2bfc47e', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:24:24 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9 Jul 07 09:24:24 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-6b2e3d5c-ad48-47fb-819d-23127252dd2c req-96033144-82c9-4b6c-a69d-9fb4346e34f9 tempest-TestStampPattern-1907711172 None] attachment_update completed successfully. Jul 07 09:24:24 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:24:24 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:25 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9" returned: 1 in 0.799s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_n9bn2nw9' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a2b1d4-e653-4207-916c-917f80e1fe40]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:25 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefc3c7-dd2f-46af-8c47-f99a533f306d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:25 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD Jul 07 09:24:25 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:25 devstack sudo[100537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:24:25 devstack sudo[100537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:26 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 was qcow2, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:26 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:26 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:26 devstack sudo[100537]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:26 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img Jul 07 09:24:26 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:26 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:26 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.908s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:27 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:24:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:24:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:24:30 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 0 in 3.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:30 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_6i0x3cxvdevstack@QuobyteHD, size 112.00 MB, duration 3.70 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:24:30 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Converted 112.00 MB image at 30.24 MB/s Jul 07 09:24:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:30 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 1G Jul 07 09:24:30 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:31 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 1G" returned: 0 in 1.550s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:31 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c26a6a-6dd5-485c-99d1-d874ecea5aa5]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:31 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:31 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:32 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img" returned: 0 in 5.580s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[99994cc2-ad01-47d2-9237-5ac5c0b9a16c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:32 devstack sudo[100910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:24:32 devstack sudo[100910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:32 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 0 in 0.908s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:32 devstack sudo[100923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:32 devstack sudo[100923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:33 devstack sudo[100910]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 1.042s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6, size 1024.00 MB, duration 5.58 sec, destination /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:24:33 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Converted 1024.00 MB image at 183.41 MB/s Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] 820f600b-5dcb-4f2e-bb6e-b14ad3d08a19 was raw, converting to qcow2 {{(pid=86769) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f48b3-479f-418a-b6d1-64164d083cfb]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:33 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img Jul 07 09:24:33 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:33 devstack sudo[100923]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 1 in 0.790s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Downloaded image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume 4830cecf-ea8d-4fd6-8e0e-f4a94955e885 successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 for user 0ea84d2ef17b4d0dbc5b60583849807b is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Marking volume 4830cecf-ea8d-4fd6-8e0e-f4a94955e885 as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Copying metadata from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 to 4830cecf-ea8d-4fd6-8e0e-f4a94955e885. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Creating volume glance metadata for volume 4830cecf-ea8d-4fd6-8e0e-f4a94955e885 backed by image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1caccb18-f166-4045-97b9-d577bd7db84f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd72ed4-8047-46fc-b654-ae308af1189e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:33 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Volume volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 (4830cecf-ea8d-4fd6-8e0e-f4a94955e885): created successfully Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd72ed4-8047-46fc-b654-ae308af1189e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Flow 'volume_create_manager' (ce18bfa3-02ec-43d3-8127-9f955c2e9610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e76014f1-f68c-422a-9666-63383985a572 tempest-VolumesImageMetadata-1138571381 None] Created volume successfully. Jul 07 09:24:33 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img" returned: 0 in 0.702s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:33 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img Jul 07 09:24:33 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-8d4127a7-2b22-40f9-a39e-fc05673946de req-3f3fdf93-95e1-4b3d-9694-8fda7563bb55 tempest-TestStampPattern-1907711172 None] Terminate volume connection completed successfully. Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-8d4127a7-2b22-40f9-a39e-fc05673946de req-3f3fdf93-95e1-4b3d-9694-8fda7563bb55 tempest-TestStampPattern-1907711172 None] Deleting attachment 91b37a86-e676-4ad1-8cc8-13aad2bfc47e. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Acquiring lock "cinder-4830cecf-ea8d-4fd6-8e0e-f4a94955e885-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:34 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Lock "cinder-4830cecf-ea8d-4fd6-8e0e-f4a94955e885-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img" returned: 1 in 0.749s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:34 devstack sudo[100969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh Jul 07 09:24:34 devstack sudo[100969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Acquiring lock "cinder-quobyte-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Lock "cinder-quobyte-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c5333-5649-4183-b9cb-2814a1bac921]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:34 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:34 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:35 devstack sudo[100969]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh" returned: 0 in 0.646s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:35 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Image conversion details: src /opt/stack/data/cinder/conversion/c58fe54a-063c-4aac-99dd-1651979c66f6.temp_image.820f600b-5dcb-4f2e-bb6e-b14ad3d08a19gemcnmxz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:24:35 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 07 09:24:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7facfe80-95a5-419a-b4f4-f270d24a2f59]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:35 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh Jul 07 09:24:35 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:35 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:35 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:35 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:36 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_s9teaxxh" returned: 0 in 0.763s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:36 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 1 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:24:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:36 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885 Jul 07 09:24:36 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:37 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" returned: 0 in 0.705s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Lock "cinder-quobyte-4830cecf-ea8d-4fd6-8e0e-f4a94955e885" released by "delete_volume" :: held 2.393s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Created reservations ['2f9776fb-f9aa-431f-a2b2-326f510ce2a8', 'dd031afa-b935-46e5-ad54-6d66b9db16b5', 'c80c9803-e5b3-4f5b-be2f-3ce9ac3ba3bf', 'ef382764-db55-4ea4-8e07-6d3e220758ea'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:37 devstack sudo[100992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:37 devstack sudo[100992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.580s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Uploaded volume to glance image-id: 820f600b-5dcb-4f2e-bb6e-b14ad3d08a19. {{(pid=86769) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.695s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Creating offline snapshot 1cabc517-2606-44f4-a49c-12de1c653e2c of volume 7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:24:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7600ffce-3a58-4027-8dba-80cbf4bf2639 tempest-VolumesActionsTest-739177780 None] Copy volume to image completed successfully. Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3485b7b1-d042-4b9c-931e-00b95c82380e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:37 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:24:37 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:37 devstack sudo[100992]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.692s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Deleted volume successfully. Jul 07 09:24:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1dfed95f-43fb-4090-a943-ad4e605cd5f3 tempest-VolumesImageMetadata-1138571381 None] Lock "cinder-4830cecf-ea8d-4fd6-8e0e-f4a94955e885-delete_volume" released by "delete_volume" :: held 3.320s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Acquiring lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Acquiring lock "cinder-quobyte-c58fe54a-063c-4aac-99dd-1651979c66f6" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Lock "cinder-quobyte-c58fe54a-063c-4aac-99dd-1651979c66f6" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b12273-8578-4498-8d34-911d502687c3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:38 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 0.890s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:38 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c 1G Jul 07 09:24:38 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:38 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:24:38 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:39 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:39 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.947s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c 1G" returned: 0 in 0.928s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:39 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6 Jul 07 09:24:39 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:39 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c Jul 07 09:24:39 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:40 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c" returned: 0 in 0.860s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:40 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c is being set with open permissions: ugo+rw Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:40 devstack sudo[101064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c Jul 07 09:24:40 devstack sudo[101064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:40 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c58fe54a-063c-4aac-99dd-1651979c66f6" returned: 0 in 0.954s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Lock "cinder-quobyte-c58fe54a-063c-4aac-99dd-1651979c66f6" released by "delete_volume" :: held 1.953s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Created reservations ['5157043d-fce7-4127-a3bd-56f8d2071cdd', '7cac3dc6-a460-4f1e-9c80-5ea5c8b01772', '8826c372-b607-45fa-832f-0fca30d0c2ea', '168e86ea-dcd6-4b8a-9c79-18db599bda42'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:40 devstack sudo[101066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:40 devstack sudo[101066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:40 devstack sudo[101064]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c" returned: 0 in 0.786s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:40 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info Jul 07 09:24:40 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:41 devstack sudo[101066]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.769s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:41 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Deleted volume successfully. Jul 07 09:24:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fdac9558-538d-4f56-9e59-bdb94747c182 tempest-VolumesActionsTest-739177780 None] Lock "cinder-c58fe54a-063c-4aac-99dd-1651979c66f6-delete_volume" released by "delete_volume" :: held 3.039s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:41 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info" returned: 0 in 0.795s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:41 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info is being set with open permissions: ugo+rw Jul 07 09:24:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:41 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info Jul 07 09:24:41 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:42 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.info" returned: 0 in 0.748s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.125s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-deec9b0a-3b0a-48d7-868c-004371783fec tempest-TestStampPattern-1907711172 None] Create snapshot completed successfully Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Flow 'volume_create_manager' (b294590c-e57f-4a62-acad-08f245d508ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a8df9b-c963-45d3-a0c4-ff88e0e64ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0a8df9b-c963-45d3-a0c4-ff88e0e64ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-440095770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5253757-c09f-44cf-90df-fa7f4b847bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15e7168adc64a5abbf1fc6244680eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:43Z,use_quota=True,user_id='f2058b7b4e794755ab077b3c0e9fd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83a139e-3aba-4230-a9e5-1e1919b05e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d83a139e-3aba-4230-a9e5-1e1919b05e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9017a33-f070-4d43-9a1b-93ae4b567101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9017a33-f070-4d43-9a1b-93ae4b567101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5253757-c09f-44cf-90df-fa7f4b847bf3', 'volume_name': 'volume-e5253757-c09f-44cf-90df-fa7f4b847bf3', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc037ce3-3d1d-4479-9c78-bac67f97f0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc037ce3-3d1d-4479-9c78-bac67f97f0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2550efd-943d-423f-b480-62bccb576f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:43 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Volume e5253757-c09f-44cf-90df-fa7f4b847bf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5253757-c09f-44cf-90df-fa7f4b847bf3', 'volume_size': 1} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-440095770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5253757-c09f-44cf-90df-fa7f4b847bf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15e7168adc64a5abbf1fc6244680eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:43Z,use_quota=True,user_id='f2058b7b4e794755ab077b3c0e9fd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Creating volume e5253757-c09f-44cf-90df-fa7f4b847bf3 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:24:43 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:24:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:43 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 1073741824 Jul 07 09:24:43 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:44 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 1073741824" returned: 0 in 0.990s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:44 devstack sudo[101085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 Jul 07 09:24:44 devstack sudo[101085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:44 devstack sudo[101085]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3" returned: 0 in 0.640s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:24:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2550efd-943d-423f-b480-62bccb576f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5253757-c09f-44cf-90df-fa7f4b847bf3', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35385dbd-53f3-44fa-848c-4279ddd0f276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:45 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Volume volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 (e5253757-c09f-44cf-90df-fa7f4b847bf3): created successfully Jul 07 09:24:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35385dbd-53f3-44fa-848c-4279ddd0f276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Flow 'volume_create_manager' (b294590c-e57f-4a62-acad-08f245d508ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4ea5880c-95ca-4404-a2b2-567a62681536 tempest-VolumesTransfersV355Test-1875581718 None] Created volume successfully. Jul 07 09:24:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f07fc653-6388-49be-8457-7235cbccc4c4 tempest-VolumesTransfersV355Test-404748075 None] Transfer volume completed successfully. Jul 07 09:24:46 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:24:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Flow 'volume_create_manager' (2ce2b525-0bd6-45b0-aa73-808479eb7c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7362444d-5aa7-4258-b6a2-266c9b7453b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7362444d-5aa7-4258-b6a2-266c9b7453b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-568354780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f055de68-a022-46f1-a698-942eba287983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3777ba7b070647c89c7a4d9e3f898588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:47Z,use_quota=True,user_id='90380c1181524ead9253f15220b0d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364370dc-2e76-4cd3-8ced-cf95fad76d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (364370dc-2e76-4cd3-8ced-cf95fad76d58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e51daab-9e25-45e2-8032-655af407a11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e51daab-9e25-45e2-8032-655af407a11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f055de68-a022-46f1-a698-942eba287983', 'volume_name': 'volume-f055de68-a022-46f1-a698-942eba287983', 'volume_size': 2}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3ea111-8b01-4cd4-ab5c-351ea5d8332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb3ea111-8b01-4cd4-ab5c-351ea5d8332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bd9bd0-36d4-41cc-80c7-e068848b5064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Volume f055de68-a022-46f1-a698-942eba287983: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f055de68-a022-46f1-a698-942eba287983', 'volume_size': 2} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-568354780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f055de68-a022-46f1-a698-942eba287983,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3777ba7b070647c89c7a4d9e3f898588',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:47Z,use_quota=True,user_id='90380c1181524ead9253f15220b0d983',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Creating volume f055de68-a022-46f1-a698-942eba287983 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:24:47 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 2147483648 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Acquiring lock "cinder-e5253757-c09f-44cf-90df-fa7f4b847bf3-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:47 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 2147483648 Jul 07 09:24:47 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-e5253757-c09f-44cf-90df-fa7f4b847bf3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Acquiring lock "cinder-quobyte-e5253757-c09f-44cf-90df-fa7f4b847bf3" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-quobyte-e5253757-c09f-44cf-90df-fa7f4b847bf3" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[250eefe9-88f4-4611-9566-3f2a0a8e137b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:47 devstack sudo[101096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 Jul 07 09:24:47 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:48 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3" returned: 0 in 0.852s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:48 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 2147483648" returned: 0 in 0.996s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:48 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3 Jul 07 09:24:48 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:48 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 Jul 07 09:24:48 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:48 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5253757-c09f-44cf-90df-fa7f4b847bf3" returned: 0 in 0.682s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-quobyte-e5253757-c09f-44cf-90df-fa7f4b847bf3" released by "delete_volume" :: held 1.587s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:48 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983" returned: 0 in 0.668s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47bd9bd0-36d4-41cc-80c7-e068848b5064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f055de68-a022-46f1-a698-942eba287983', 'volume_size': 2}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb786c64-a406-4ab5-bef0-e9f1ec84a3de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:48 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Volume volume-f055de68-a022-46f1-a698-942eba287983 (f055de68-a022-46f1-a698-942eba287983): created successfully Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb786c64-a406-4ab5-bef0-e9f1ec84a3de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Flow 'volume_create_manager' (2ce2b525-0bd6-45b0-aa73-808479eb7c0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-70ea6d88-112f-474e-ba49-0f66eddb7dfc tempest-VolumesCloneNegativeTest-1093875720 None] Created volume successfully. Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Created reservations ['e2970505-2a94-470b-a44d-fcd7c2090e2f', '51c4535b-5ba9-4f07-9e09-07b30dc78b0a', '3cf77322-0a6e-4bd0-8c2e-9fdc90b44c10', '2836668d-2704-41c3-888e-bb3420ec495b'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:48 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:48 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Acquiring lock "cinder-f055de68-a022-46f1-a698-942eba287983-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Lock "cinder-f055de68-a022-46f1-a698-942eba287983-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Acquiring lock "cinder-quobyte-f055de68-a022-46f1-a698-942eba287983" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Lock "cinder-quobyte-f055de68-a022-46f1-a698-942eba287983" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ace3661-9e80-4fd0-924d-695992e77946]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:49 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 Jul 07 09:24:49 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:49 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Deleted volume successfully. Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d750e955-a72f-4994-be24-c0d095169ad5 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-e5253757-c09f-44cf-90df-fa7f4b847bf3-delete_volume" released by "delete_volume" :: held 2.581s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Flow 'volume_create_manager' (ff1ee58f-0b7a-4d8d-b06d-4a026a86b131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59a8435-4934-4803-be95-6df9a7283eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a59a8435-4934-4803-be95-6df9a7283eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1119150187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32108f3b-3943-416e-9f60-95f0bcb55b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15e7168adc64a5abbf1fc6244680eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:50Z,use_quota=True,user_id='f2058b7b4e794755ab077b3c0e9fd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90059e2a-b16a-4b4a-bdb3-b5c0248fa5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90059e2a-b16a-4b4a-bdb3-b5c0248fa5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab848c26-9b19-4f04-af5f-2293555ccccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab848c26-9b19-4f04-af5f-2293555ccccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32108f3b-3943-416e-9f60-95f0bcb55b6f', 'volume_name': 'volume-32108f3b-3943-416e-9f60-95f0bcb55b6f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10178d3d-1570-442c-a958-e2f2012cc705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10178d3d-1570-442c-a958-e2f2012cc705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872e6a19-a86f-42a3-910c-2cbbba739885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:49 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Volume 32108f3b-3943-416e-9f60-95f0bcb55b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32108f3b-3943-416e-9f60-95f0bcb55b6f', 'volume_size': 1} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1119150187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32108f3b-3943-416e-9f60-95f0bcb55b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b15e7168adc64a5abbf1fc6244680eec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:50Z,use_quota=True,user_id='f2058b7b4e794755ab077b3c0e9fd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Creating volume 32108f3b-3943-416e-9f60-95f0bcb55b6f {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:24:50 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:50 devstack sudo[101149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f 1073741824 Jul 07 09:24:50 devstack sudo[101149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:50 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983" returned: 0 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:50 devstack sudo[101154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983 Jul 07 09:24:50 devstack sudo[101154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:50 devstack sudo[101149]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f 1073741824" returned: 0 in 0.890s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:50 devstack sudo[101154]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f055de68-a022-46f1-a698-942eba287983" returned: 0 in 0.728s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Lock "cinder-quobyte-f055de68-a022-46f1-a698-942eba287983" released by "delete_volume" :: held 1.639s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:50 devstack sudo[101161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f Jul 07 09:24:50 devstack sudo[101161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Created reservations ['16f1db6c-e5ac-4e92-97fd-1f599d013cec', 'b0a3ca56-bf4b-4980-8a3a-d57c5973e3ba', 'ed59752b-694e-414b-a4a5-3b724d7bed4d', 'aa424030-b16b-44d3-9e19-2847a63808e0'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:51 devstack sudo[101163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:51 devstack sudo[101163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:51 devstack sudo[101161]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f" returned: 0 in 0.809s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (872e6a19-a86f-42a3-910c-2cbbba739885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32108f3b-3943-416e-9f60-95f0bcb55b6f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749b1b12-4c18-421c-bf5e-91023dfb1fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Volume volume-32108f3b-3943-416e-9f60-95f0bcb55b6f (32108f3b-3943-416e-9f60-95f0bcb55b6f): created successfully Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749b1b12-4c18-421c-bf5e-91023dfb1fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Flow 'volume_create_manager' (ff1ee58f-0b7a-4d8d-b06d-4a026a86b131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-abe7aa5f-0238-46d5-84df-26a650005154 tempest-VolumesTransfersV355Test-1875581718 None] Created volume successfully. Jul 07 09:24:51 devstack sudo[101163]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.873s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Deleted volume successfully. Jul 07 09:24:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-380baa86-90b4-4048-8c5b-49ce3e0f1b85 tempest-VolumesCloneNegativeTest-1093875720 None] Lock "cinder-f055de68-a022-46f1-a698-942eba287983-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Acquiring lock "cinder-32108f3b-3943-416e-9f60-95f0bcb55b6f-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-32108f3b-3943-416e-9f60-95f0bcb55b6f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Acquiring lock "cinder-quobyte-32108f3b-3943-416e-9f60-95f0bcb55b6f" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-quobyte-32108f3b-3943-416e-9f60-95f0bcb55b6f" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b577f0e2-dbcd-4051-b827-edc0af7a8413]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:52 devstack sudo[101168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f Jul 07 09:24:52 devstack sudo[101168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:24:53 devstack sudo[101168]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Flow 'volume_create_manager' (0057984c-b463-4c8d-9ec5-9de50b7d4303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c695dca6-9409-4a8a-874e-c9f381a6bf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f" returned: 0 in 0.931s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c695dca6-9409-4a8a-874e-c9f381a6bf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-406422261',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0480ec9-b392-49a4-9aa0-515fa38beddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5da3faae1f1348bb802cbf89a9e0a2d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1cabc517-2606-44f4-a49c-12de1c653e2c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:53Z,use_quota=True,user_id='d4aa4f631a4e435ab26ec3677f0e2263',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbb2749-19f0-4098-9e53-7e07075f74b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:53 devstack sudo[101173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f Jul 07 09:24:53 devstack sudo[101173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cbb2749-19f0-4098-9e53-7e07075f74b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9b140a-7a28-4e1e-b7a3-f1a16a9e1ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab9b140a-7a28-4e1e-b7a3-f1a16a9e1ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd0480ec9-b392-49a4-9aa0-515fa38beddf', 'volume_name': 'volume-d0480ec9-b392-49a4-9aa0-515fa38beddf', 'volume_size': 1, 'snapshot_id': '1cabc517-2606-44f4-a49c-12de1c653e2c'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33eaf78-b484-488d-bd5c-5ad5330848d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33eaf78-b484-488d-bd5c-5ad5330848d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f51fe9b-f896-4759-a578-da6524a80fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Volume d0480ec9-b392-49a4-9aa0-515fa38beddf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d0480ec9-b392-49a4-9aa0-515fa38beddf', 'volume_size': 1, 'snapshot_id': '1cabc517-2606-44f4-a49c-12de1c653e2c'} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-quobyte-1cabc517-2606-44f4-a49c-12de1c653e2c-d0480ec9-b392-49a4-9aa0-515fa38beddf" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-1cabc517-2606-44f4-a49c-12de1c653e2c-d0480ec9-b392-49a4-9aa0-515fa38beddf" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Creating volume d0480ec9-b392-49a4-9aa0-515fa38beddf from snapshot 1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-quobyte-d0480ec9-b392-49a4-9aa0-515fa38beddf" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-d0480ec9-b392-49a4-9aa0-515fa38beddf" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] snapshot: 1cabc517-2606-44f4-a49c-12de1c653e2c, volume: d0480ec9-b392-49a4-9aa0-515fa38beddf, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4092a32-4ef2-4c48-b5d3-b67e85dd1518]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:53 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c Jul 07 09:24:53 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:54 devstack sudo[101173]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-32108f3b-3943-416e-9f60-95f0bcb55b6f" returned: 0 in 0.777s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-quobyte-32108f3b-3943-416e-9f60-95f0bcb55b6f" released by "delete_volume" :: held 1.760s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Created reservations ['0ef538a2-3c03-4ffa-9ac6-19457594e5b4', 'e6562fa6-ee56-4691-9490-959715b07407', '16b31bd4-97e4-48cd-8de9-4df487e4b1fe', 'a21cad71-fd9c-44f6-a469-863c1e83ed74'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:54 devstack sudo[101181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:24:54 devstack sudo[101181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:54 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c" returned: 0 in 1.087s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c42996-d656-4b95-ae24-820da6727aa8]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:24:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:55 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:24:55 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:24:55 devstack sudo[101181]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (146dbe1f-7461-46e8-af88-4d9560f9a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a594e1-bb19-49a5-8875-19a88a5da372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.952s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a594e1-bb19-49a5-8875-19a88a5da372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-540804463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:55Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6657033-2a6d-42f7-a264-101a8b02bcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6657033-2a6d-42f7-a264-101a8b02bcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d519d2a-1996-47ac-8cf1-f438581cb6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d519d2a-1996-47ac-8cf1-f438581cb6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5', 'volume_name': 'volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6aafd5e-9d4e-4991-a352-18b9851eefbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6aafd5e-9d4e-4991-a352-18b9851eefbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcae2d3-a206-4365-a141-98c9f3907c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:24:55 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Volume ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5', 'volume_size': 1} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:24:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Deleted volume successfully. Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c7cf984-f320-46fe-8c9e-d6947509de33 tempest-VolumesTransfersV355Test-131511017 None] Lock "cinder-32108f3b-3943-416e-9f60-95f0bcb55b6f-delete_volume" released by "delete_volume" :: held 3.081s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:24:55 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 1.087s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:24:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:24:55 devstack sudo[101192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf Jul 07 09:24:55 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf" returned: 0 in 6.339s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[35112ffa-1fe4-451b-902e-e6608e7f5bb2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:02 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:25:02 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:03 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 1.434s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:03 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:25:03 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Converted 1024.00 MB image at 161.50 MB/s Jul 07 09:25:03 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf is being set with open permissions: ugo+rw Jul 07 09:25:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:03 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf Jul 07 09:25:03 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:04 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf" returned: 0 in 0.833s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-d0480ec9-b392-49a4-9aa0-515fa38beddf" released by "_copy_volume_from_snapshot" :: held 10.936s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-1cabc517-2606-44f4-a49c-12de1c653e2c-d0480ec9-b392-49a4-9aa0-515fa38beddf" released by "_create_volume_from_snapshot" :: held 10.980s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.087s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-540804463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:24:55Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Creating volume ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:04 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:04 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 1073741824 Jul 07 09:25:04 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f51fe9b-f896-4759-a578-da6524a80fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0480ec9-b392-49a4-9aa0-515fa38beddf', 'volume_size': 1, 'snapshot_id': '1cabc517-2606-44f4-a49c-12de1c653e2c'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e5dba-c95a-4bf3-82fc-ec14262ef7bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Volume volume-d0480ec9-b392-49a4-9aa0-515fa38beddf (d0480ec9-b392-49a4-9aa0-515fa38beddf): created successfully Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e9e5dba-c95a-4bf3-82fc-ec14262ef7bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Flow 'volume_create_manager' (0057984c-b463-4c8d-9ec5-9de50b7d4303) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6d0489b9-6d46-479d-8407-f56744f0705b tempest-TestStampPattern-1907711172 None] Created volume successfully. Jul 07 09:25:05 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 1073741824" returned: 0 in 0.969s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:05 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 Jul 07 09:25:05 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:06 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5" returned: 0 in 0.716s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dcae2d3-a206-4365-a141-98c9f3907c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030cc8d8-3df1-4bab-a939-7d04a3abe345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Volume volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 (ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5): created successfully Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030cc8d8-3df1-4bab-a939-7d04a3abe345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (146dbe1f-7461-46e8-af88-4d9560f9a321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-900df4b5-9b00-44fb-b7c0-2adbecb6dc01 tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (55934d3c-f951-48bd-a94c-47e4af233ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7d6d66-0424-4bdd-83d8-96de88d687e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7d6d66-0424-4bdd-83d8-96de88d687e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1205794505',display_name='tempest-VolumesGetTest-Volume-1263424927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91843a0-e890-4990-92ee-2ed765d05001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:07Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78364c3-78a8-494c-8990-3f47a68364a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f78364c3-78a8-494c-8990-3f47a68364a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e27591-c9a5-47fc-a4bd-4ffd8c9a5370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3e27591-c9a5-47fc-a4bd-4ffd8c9a5370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b91843a0-e890-4990-92ee-2ed765d05001', 'volume_name': 'volume-b91843a0-e890-4990-92ee-2ed765d05001', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c48af2-b280-4fa9-8b2c-5930fd7bdbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c48af2-b280-4fa9-8b2c-5930fd7bdbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e17ebd0-77c0-4bf6-b7f9-d3322b70452b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:07 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Volume b91843a0-e890-4990-92ee-2ed765d05001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b91843a0-e890-4990-92ee-2ed765d05001', 'volume_size': 1} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1205794505',display_name='tempest-VolumesGetTest-Volume-1263424927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b91843a0-e890-4990-92ee-2ed765d05001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:07Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Creating volume b91843a0-e890-4990-92ee-2ed765d05001 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:07 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:07 devstack sudo[101464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 1073741824 Jul 07 09:25:07 devstack sudo[101464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:08 devstack sudo[101464]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 1073741824" returned: 0 in 0.997s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:08 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 Jul 07 09:25:08 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:09 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001" returned: 0 in 0.762s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e17ebd0-77c0-4bf6-b7f9-d3322b70452b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b91843a0-e890-4990-92ee-2ed765d05001', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebeeb51-4974-41a5-99ac-5f14be1fe7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:09 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Volume volume-b91843a0-e890-4990-92ee-2ed765d05001 (b91843a0-e890-4990-92ee-2ed765d05001): created successfully Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ebeeb51-4974-41a5-99ac-5f14be1fe7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (55934d3c-f951-48bd-a94c-47e4af233ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-dba67a70-e73e-4569-a08e-3abc86b3c4e6 tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-b91843a0-e890-4990-92ee-2ed765d05001-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Lock "cinder-b91843a0-e890-4990-92ee-2ed765d05001-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-b91843a0-e890-4990-92ee-2ed765d05001" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-b91843a0-e890-4990-92ee-2ed765d05001" acquired by "delete_volume" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:10 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f9553-6500-4266-b030-55e42f2a9d90]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:10 devstack sudo[101634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 Jul 07 09:25:10 devstack sudo[101634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:11 devstack sudo[101634]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001" returned: 0 in 1.025s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:11 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001 Jul 07 09:25:11 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:11 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b91843a0-e890-4990-92ee-2ed765d05001" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-b91843a0-e890-4990-92ee-2ed765d05001" released by "delete_volume" :: held 1.828s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:11 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Created reservations ['e9160faa-eb4d-442c-b55c-7619ef9c4f86', '3464fa94-372e-4310-9b36-db9954f7a80c', '7536c312-2c1a-413b-8729-7eb17af7a0ed', 'c4699e0c-595a-4c61-b167-d297ec794c4d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:12 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:25:12 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Lock "cinder-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=59,cinder:INSERT=22,cinder:UPDATE=78,cinder:DELETE=4 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=71,cinder:UPDATE=69,cinder:INSERT=22,cinder:DELETE=9 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5" acquired by "delete_volume" :: waited 0.057s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ec6bb-90c9-4db3-bcc9-fffc206b2fc6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:12 devstack sudo[101731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 Jul 07 09:25:12 devstack sudo[101731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:13 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.309s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:13 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:25:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:25:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7995c42e-ba78-4259-940b-a2c1c077018a tempest-VolumesGetTest-201428079 None] Lock "cinder-b91843a0-e890-4990-92ee-2ed765d05001-delete_volume" released by "delete_volume" :: held 3.653s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:14 devstack sudo[101731]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5" returned: 0 in 1.257s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:14 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5 Jul 07 09:25:14 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:15 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5" returned: 0 in 1.097s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5" released by "delete_volume" :: held 2.440s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Created reservations ['81bc7c36-6ce6-44ef-aa40-b43aeceb56d1', '4651715a-0c2b-4177-a79e-3c6bcef78f41', '70bf794d-8975-410e-b5e8-826d404f35be', 'a6545249-b0eb-4a00-a4db-b5af889aca15'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:15 devstack sudo[101741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:25:15 devstack sudo[101741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:16 devstack sudo[101741]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:25:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ebd1958-e38c-4ea1-830c-e6434e10509e tempest-VolumesGetTest-201428079 None] Lock "cinder-ce9ae2fb-70ca-4f32-9f3c-e9a04610ccd5-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (c96e7635-b479-46c3-950b-4e34dfc1b418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b3d348-d791-48e5-8e27-cec88819a9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81b3d348-d791-48e5-8e27-cec88819a9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424087590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:17Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccd2bd5-62d7-4754-8dd3-a25f8612c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eccd2bd5-62d7-4754-8dd3-a25f8612c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7981e999-f3f0-4d6d-b892-b01126f29609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7981e999-f3f0-4d6d-b892-b01126f29609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'volume_name': 'volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc11343-9c64-4459-afde-8e7b5b3f5a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dc11343-9c64-4459-afde-8e7b5b3f5a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410f0faa-3f15-4e19-9ddb-c56674f593e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:16 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Volume cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'volume_size': 1} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-424087590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:17Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Creating volume cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:16 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:16 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 1073741824 Jul 07 09:25:16 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:17 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 1073741824" returned: 0 in 1.075s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:18 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:18 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (0646dcfc-3836-4316-9edd-a7e8f1e31343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:18 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98725c53-0063-4bba-ad41-ad34bd2a7ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.708s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98725c53-0063-4bba-ad41-ad34bd2a7ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1820652437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0377b10-e77d-4500-ba4e-d99fc0bbcd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:19Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a881e2bf-b21c-489d-89ca-a431e86f1d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a881e2bf-b21c-489d-89ca-a431e86f1d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f814527f-397e-4de8-962a-eb41500fa509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f814527f-397e-4de8-962a-eb41500fa509) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0377b10-e77d-4500-ba4e-d99fc0bbcd2c', 'volume_name': 'volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700746d2-089e-4fd4-9ec5-0af3aef4d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (700746d2-089e-4fd4-9ec5-0af3aef4d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ff6ca8-3fc2-45d5-aa14-958c2364b310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Volume b0377b10-e77d-4500-ba4e-d99fc0bbcd2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c', 'volume_size': 1} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1820652437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0377b10-e77d-4500-ba4e-d99fc0bbcd2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:19Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Creating volume b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:18 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (410f0faa-3f15-4e19-9ddb-c56674f593e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea66cf7e-db58-43a4-8987-487d08ad64f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:18 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c 1073741824 Jul 07 09:25:18 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Volume volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 (cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1): created successfully Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea66cf7e-db58-43a4-8987-487d08ad64f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (c96e7635-b479-46c3-950b-4e34dfc1b418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b717460d-71a8-462a-9526-cc45c6b27cd8 tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:25:19 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c 1073741824" returned: 0 in 0.828s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:19 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c Jul 07 09:25:19 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:20 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" returned: 0 in 0.707s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82ff6ca8-3fc2-45d5-aa14-958c2364b310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6492bf57-36a8-4903-921b-ba1a1e4b8946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Volume volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c (b0377b10-e77d-4500-ba4e-d99fc0bbcd2c): created successfully Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6492bf57-36a8-4903-921b-ba1a1e4b8946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (0646dcfc-3836-4316-9edd-a7e8f1e31343) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-970b4365-671d-49d4-9f0e-24db95f44bf5 tempest-VolumesSnapshotTestJSON-1591342045 None] Created volume successfully. Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (5231cd20-40fb-4170-a9b4-c12fcfa82475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97be00a-780b-4928-b247-2477f2a3b833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a97be00a-780b-4928-b247-2477f2a3b833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2068106652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58b7c9c6-1188-4f9b-a536-ec2674e42876,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:20Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46318cf3-b6a0-474c-99bb-e81ca16c0d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46318cf3-b6a0-474c-99bb-e81ca16c0d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df1d0ce-364c-485f-8c3f-a0cea2c17408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4df1d0ce-364c-485f-8c3f-a0cea2c17408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '58b7c9c6-1188-4f9b-a536-ec2674e42876', 'volume_name': 'volume-58b7c9c6-1188-4f9b-a536-ec2674e42876', 'volume_size': 1, 'source_volid': 'cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'source_volstatus': 'available'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a27932-aefc-437e-997f-c480225d0ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78a27932-aefc-437e-997f-c480225d0ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ddf898-7e49-4db9-a61f-54fc53a73159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Volume 58b7c9c6-1188-4f9b-a536-ec2674e42876: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-58b7c9c6-1188-4f9b-a536-ec2674e42876', 'volume_size': 1, 'source_volid': 'cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'source_volstatus': 'available'} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:20 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Cloning volume cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 to volume 58b7c9c6-1188-4f9b-a536-ec2674e42876 Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Creating offline snapshot aefad4f8-f115-43e7-ab8e-262f41c4783a of volume cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa93c4d4-4c35-4b80-bfb8-10dca8878c78]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:20 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:20 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:21 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:21 devstack sudo[101768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a 1G Jul 07 09:25:21 devstack sudo[101768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:22 devstack sudo[101768]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a 1G" returned: 0 in 0.880s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:22 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a Jul 07 09:25:22 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:23 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a" returned: 0 in 0.737s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:23 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a is being set with open permissions: ugo+rw Jul 07 09:25:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:23 devstack sudo[101791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a Jul 07 09:25:23 devstack sudo[101791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:23 devstack sudo[101791]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a" returned: 0 in 0.647s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:23 devstack sudo[101794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info Jul 07 09:25:23 devstack sudo[101794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:24 devstack sudo[101794]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info" returned: 0 in 0.646s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:24 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info is being set with open permissions: ugo+rw Jul 07 09:25:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:24 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info Jul 07 09:25:24 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:25 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.info" returned: 0 in 0.647s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-58b7c9c6-1188-4f9b-a536-ec2674e42876" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-58b7c9c6-1188-4f9b-a536-ec2674e42876" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] snapshot: aefad4f8-f115-43e7-ab8e-262f41c4783a, volume: 58b7c9c6-1188-4f9b-a536-ec2674e42876, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8687de0a-5ee4-496b-b974-7b530303e066]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:25 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a Jul 07 09:25:25 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:25 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a" returned: 0 in 0.751s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a48ba8-3478-4be1-89d5-a5e36c4674fc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:26 devstack sudo[101805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:26 devstack sudo[101805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:26 devstack sudo[101805]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.749s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:26 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 Jul 07 09:25:26 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:26 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:25:26 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:27 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:25:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:25:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:25:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:25:31 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876" returned: 0 in 4.575s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:31 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[03597895-7bb6-4be4-910d-2f27e6f355db]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:31 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:31 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:32 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.901s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1, size 1024.00 MB, duration 4.58 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:25:32 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Converted 1024.00 MB image at 223.78 MB/s Jul 07 09:25:32 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 is being set with open permissions: ugo+rw Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:32 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 Jul 07 09:25:32 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:32 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876" returned: 0 in 0.637s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-58b7c9c6-1188-4f9b-a536-ec2674e42876" released by "_copy_volume_from_snapshot" :: held 7.692s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-aefad4f8-f115-43e7-ab8e-262f41c4783a" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-aefad4f8-f115-43e7-ab8e-262f41c4783a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Deleting offline snapshot aefad4f8-f115-43e7-ab8e-262f41c4783a of volume cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] snapshot_file for this snap is: volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5a165e-60ab-4693-a415-1ac1e916a840]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:32 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a Jul 07 09:25:32 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:33 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:25:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eaccca-385f-4d48-b0d5-f78a89fb07ef]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:33 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:33 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:34 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.742s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:34 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a Jul 07 09:25:34 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:35 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:35 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a Jul 07 09:25:35 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:35 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1.aefad4f8-f115-43e7-ab8e-262f41c4783a" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-aefad4f8-f115-43e7-ab8e-262f41c4783a" released by "_delete_snapshot" :: held 3.010s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.319s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.866s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Creating offline snapshot f618b6a7-dc59-4321-84bf-c7d49178fded of volume b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80ddf898-7e49-4db9-a61f-54fc53a73159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58b7c9c6-1188-4f9b-a536-ec2674e42876', 'volume_size': 1, 'source_volid': 'cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1', 'source_volstatus': 'available'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d70dc2-28b3-4980-a449-9f9f9dce17a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed30a9d0-1ccd-4830-95ed-49234991b348]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Volume volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 (58b7c9c6-1188-4f9b-a536-ec2674e42876): created successfully Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97d70dc2-28b3-4980-a449-9f9f9dce17a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (5231cd20-40fb-4170-a9b4-c12fcfa82475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0f534036-c47c-48e9-aa7b-a8ac9eb0aa65 tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:25:36 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c Jul 07 09:25:36 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:36 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" returned: 0 in 0.790s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:36 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded 1G Jul 07 09:25:36 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (4d0248d1-67d2-4767-a36f-670f00a2e338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4706a82-862b-4181-aec4-167f3f5a6bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4706a82-862b-4181-aec4-167f3f5a6bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-745499719',display_name='tempest-VolumesGetTest-Volume-457494396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9025445-af94-43df-ad7e-9dffc374dc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:37Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ee6f47-11fd-416f-aee7-37b26cb978fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18ee6f47-11fd-416f-aee7-37b26cb978fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdae3d0-07b0-4017-8946-80aae22643d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbdae3d0-07b0-4017-8946-80aae22643d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9025445-af94-43df-ad7e-9dffc374dc66', 'volume_name': 'volume-c9025445-af94-43df-ad7e-9dffc374dc66', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e32db0-e69e-497c-869c-67729ba7f7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e32db0-e69e-497c-869c-67729ba7f7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8bb78e-4956-4b0c-a78a-0707c4aa1677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Volume c9025445-af94-43df-ad7e-9dffc374dc66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9025445-af94-43df-ad7e-9dffc374dc66', 'volume_size': 1} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:37 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded 1G" returned: 0 in 0.845s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:37 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded Jul 07 09:25:37 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:38 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded" returned: 0 in 0.711s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:38 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded is being set with open permissions: ugo+rw Jul 07 09:25:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:38 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded Jul 07 09:25:38 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:38 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded" returned: 0 in 0.649s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:38 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info Jul 07 09:25:38 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:39 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info" returned: 0 in 0.651s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:39 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info is being set with open permissions: ugo+rw Jul 07 09:25:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:39 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info Jul 07 09:25:39 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:40 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.info" returned: 0 in 0.717s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.454s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.998s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-745499719',display_name='tempest-VolumesGetTest-Volume-457494396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9025445-af94-43df-ad7e-9dffc374dc66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:37Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Creating volume c9025445-af94-43df-ad7e-9dffc374dc66 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:40 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:40 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 1073741824 Jul 07 09:25:40 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:40 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-90dbf1de-cf10-49c5-9c93-d52186775a76 tempest-VolumesSnapshotTestJSON-1591342045 None] Create snapshot completed successfully Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-f618b6a7-dc59-4321-84bf-c7d49178fded-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-f618b6a7-dc59-4321-84bf-c7d49178fded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-f618b6a7-dc59-4321-84bf-c7d49178fded" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-f618b6a7-dc59-4321-84bf-c7d49178fded" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Deleting offline snapshot f618b6a7-dc59-4321-84bf-c7d49178fded of volume b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] snapshot_file for this snap is: volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b7babe2-de56-4eb4-92ad-9a8e18a20c8d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:41 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded Jul 07 09:25:41 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:41 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 1073741824" returned: 0 in 0.945s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:41 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 Jul 07 09:25:41 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:41 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded" returned: 0 in 0.786s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8a6066-5cd4-4adc-a8d4-c66efa912144]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:42 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c Jul 07 09:25:42 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:42 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66" returned: 0 in 0.688s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.848s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[815cfd3d-d33b-4994-9fec-fa9210cad962]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8bb78e-4956-4b0c-a78a-0707c4aa1677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9025445-af94-43df-ad7e-9dffc374dc66', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086bf20-0b60-4caa-9ca1-4ff3723b3176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:42 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Volume volume-c9025445-af94-43df-ad7e-9dffc374dc66 (c9025445-af94-43df-ad7e-9dffc374dc66): created successfully Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b086bf20-0b60-4caa-9ca1-4ff3723b3176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (4d0248d1-67d2-4767-a36f-670f00a2e338) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-860e2162-3726-460e-9088-5cad8769d9e3 tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:25:42 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf Jul 07 09:25:42 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-c9025445-af94-43df-ad7e-9dffc374dc66-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Lock "cinder-c9025445-af94-43df-ad7e-9dffc374dc66-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:42 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" returned: 0 in 0.846s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:42 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded Jul 07 09:25:42 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-c9025445-af94-43df-ad7e-9dffc374dc66" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-c9025445-af94-43df-ad7e-9dffc374dc66" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb57b4b-75e2-4a34-a523-f68fac34c348]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:42 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf" returned: 0 in 0.882s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.898s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-d0480ec9-b392-49a4-9aa0-515fa38beddf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6451ae27-c6b3-4274-9b48-24731f2dfb4b', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:25:42 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 Jul 07 09:25:42 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-ec2db1ae-e978-494f-942a-e97324122594 req-428df511-4382-4441-8ce9-389dc42680d1 tempest-TestStampPattern-1907711172 None] attachment_update completed successfully. Jul 07 09:25:43 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded" returned: 0 in 0.782s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:43 devstack sudo[102043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded Jul 07 09:25:43 devstack sudo[102043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:43 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:43 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66 Jul 07 09:25:43 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:44 devstack sudo[102043]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c.f618b6a7-dc59-4321-84bf-c7d49178fded" returned: 0 in 0.697s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-f618b6a7-dc59-4321-84bf-c7d49178fded" released by "_delete_snapshot" :: held 3.219s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" released by "delete_snapshot" :: held 3.242s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['a4f163f6-2757-45bc-ad29-ef2a96130b0c', 'c5a6d523-fead-49a0-94f5-3823c0252ce2', '814fcd65-96f4-438d-83fd-ada7c26c8954', '1ef21cc5-9dde-484e-b07b-813145cfee46'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:25:44 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Delete snapshot completed successfully. Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ce92bcde-c42d-492d-aa5c-65955ebc147e tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-f618b6a7-dc59-4321-84bf-c7d49178fded-delete_snapshot" released by "delete_snapshot" :: held 3.426s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:44 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c9025445-af94-43df-ad7e-9dffc374dc66" returned: 0 in 0.710s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-c9025445-af94-43df-ad7e-9dffc374dc66" released by "delete_volume" :: held 1.597s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Created reservations ['400927af-2a55-4ce2-968d-59939fc066b3', 'a28863dc-6c00-403e-8b8f-db5d0af43b6a', '5c0a6581-d64e-4ef9-9e37-1fda7407f6f5', 'eacba538-dfce-42c9-ae54-c792606991ff'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:44 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:25:44 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-58b7c9c6-1188-4f9b-a536-ec2674e42876-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Lock "cinder-58b7c9c6-1188-4f9b-a536-ec2674e42876-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-58b7c9c6-1188-4f9b-a536-ec2674e42876" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-58b7c9c6-1188-4f9b-a536-ec2674e42876" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6042174-3a3a-4ace-a822-b5e69df8b0e2]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:45 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:25:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-41d6a6e0-e4dd-444f-b9fb-4a38308829ea tempest-VolumesGetTest-201428079 None] Lock "cinder-c9025445-af94-43df-ad7e-9dffc374dc66-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:45 devstack sudo[102370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 Jul 07 09:25:45 devstack sudo[102370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (8922f462-ce0a-401f-9193-b6a097c32ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4726586-6f30-431f-b9ca-42b3fad6dfe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4726586-6f30-431f-b9ca-42b3fad6dfe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1222195610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91f4f1a-442e-498c-825a-d46718b34d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:46Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f42d01-2237-4ca3-88eb-0047fcb8ca33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3f42d01-2237-4ca3-88eb-0047fcb8ca33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac9ad85-469d-4ba7-bc5b-2a2080e9577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac9ad85-469d-4ba7-bc5b-2a2080e9577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91f4f1a-442e-498c-825a-d46718b34d32', 'volume_name': 'volume-c91f4f1a-442e-498c-825a-d46718b34d32', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ceeab28-f817-467c-b655-647a1d5a927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ceeab28-f817-467c-b655-647a1d5a927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf914bc-7d57-4b6a-9d0f-478b080d8b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:45 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Volume c91f4f1a-442e-498c-825a-d46718b34d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91f4f1a-442e-498c-825a-d46718b34d32', 'volume_size': 1} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1222195610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91f4f1a-442e-498c-825a-d46718b34d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:46Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Creating volume c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:45 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:45 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 1073741824 Jul 07 09:25:45 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:46 devstack sudo[102370]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876" returned: 0 in 0.822s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:46 devstack sudo[102377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876 Jul 07 09:25:46 devstack sudo[102377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:46 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 1073741824" returned: 0 in 0.842s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:46 devstack sudo[102377]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-58b7c9c6-1188-4f9b-a536-ec2674e42876" returned: 0 in 0.715s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:46 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:25:46 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-58b7c9c6-1188-4f9b-a536-ec2674e42876" released by "delete_volume" :: held 1.607s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Created reservations ['91b7b5a3-2be2-47ee-ac15-0be311515303', 'b201fc6c-b183-47dc-b8ed-65dbc5ba3af3', '9a92ec85-1bd1-480a-b9b8-02ce9e82aabe', 'ef9db741-a737-4b8c-95cc-30b4a1a096fa'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:46 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:25:46 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:47 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 0.718s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Lock "cinder-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbf914bc-7d57-4b6a-9d0f-478b080d8b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91f4f1a-442e-498c-825a-d46718b34d32', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6530eb-6b72-4ada-bc6b-ac2caaf0517f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Volume volume-c91f4f1a-442e-498c-825a-d46718b34d32 (c91f4f1a-442e-498c-825a-d46718b34d32): created successfully Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6530eb-6b72-4ada-bc6b-ac2caaf0517f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (8922f462-ce0a-401f-9193-b6a097c32ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a6668f66-e617-44cd-8486-7b21455c547d tempest-VolumesSnapshotTestJSON-1591342045 None] Created volume successfully. Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8267b3a-25c4-4569-aad3-7200b8912cdd]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:47 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.755s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:25:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:25:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2b9b4b5b-23f5-4f6d-9a3d-371f2e2c6418 tempest-VolumesGetTest-201428079 None] Lock "cinder-58b7c9c6-1188-4f9b-a536-ec2674e42876-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:47 devstack sudo[102405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:47 devstack sudo[102405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Creating offline snapshot e28cfedd-1918-45e7-860d-822461c85d77 of volume c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b805b47e-3af1-4c71-8762-0295b5524bb9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:48 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:25:48 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:48 devstack sudo[102405]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.891s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:48 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1 Jul 07 09:25:48 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:48 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 0.819s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:48 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 1G Jul 07 09:25:48 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:49 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" returned: 0 in 0.662s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1" released by "delete_volume" :: held 1.621s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Created reservations ['5fae7207-5b54-4645-95e2-a62ecdc3aa3d', '45eca11f-2a0d-44b4-9436-5927290f4a08', '137667d3-6d51-4a54-b980-c4dabea326a6', '3966446c-f362-4de7-845c-99e5ce87d38d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:49 devstack sudo[102427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:25:49 devstack sudo[102427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-b7891e50-866a-4ee8-8923-de483f06245c req-8b1ce17c-5c2a-47be-99f0-2ee808cf1989 tempest-TestStampPattern-1907711172 None] Terminate volume connection completed successfully. Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-b7891e50-866a-4ee8-8923-de483f06245c req-8b1ce17c-5c2a-47be-99f0-2ee808cf1989 tempest-TestStampPattern-1907711172 None] Deleting attachment 6451ae27-c6b3-4274-9b48-24731f2dfb4b. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:25:49 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 1G" returned: 0 in 0.986s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c91f4f1a-442e-498c-825a-d46718b34d32 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:49 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c91f4f1a-442e-498c-825a-d46718b34d32 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 Jul 07 09:25:49 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:50 devstack sudo[102427]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:25:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-75ac1aa0-d027-4e12-8cab-fb4bc699a3d5 tempest-VolumesGetTest-201428079 None] Lock "cinder-cfaec1c1-13f0-48b4-b8d6-0954c39e9fa1-delete_volume" released by "delete_volume" :: held 2.663s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:25:50 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (2ce29be8-92dd-4a5e-a6e3-4b21b3a66011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4898965f-d8c5-42f7-83a7-8d05f916ad67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c91f4f1a-442e-498c-825a-d46718b34d32 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77" returned: 0 in 0.813s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:50 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 is being set with open permissions: ugo+rw Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4898965f-d8c5-42f7-83a7-8d05f916ad67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1002298902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce34dea-105a-4b7e-806e-44fe880dbb6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:51Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:50 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 Jul 07 09:25:50 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfbf265-8c0a-4db2-9b35-d10b8ae3ed4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bfbf265-8c0a-4db2-9b35-d10b8ae3ed4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346f03ec-86e1-4c65-b905-66bdc2e01084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:50 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (346f03ec-86e1-4c65-b905-66bdc2e01084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fce34dea-105a-4b7e-806e-44fe880dbb6d', 'volume_name': 'volume-fce34dea-105a-4b7e-806e-44fe880dbb6d', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e664e3-aaff-424a-82c4-49d0c2775073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8e664e3-aaff-424a-82c4-49d0c2775073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb57eb98-d3ce-4b67-a935-5ca1c4ad2def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Volume fce34dea-105a-4b7e-806e-44fe880dbb6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fce34dea-105a-4b7e-806e-44fe880dbb6d', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Trying to clone fce34dea-105a-4b7e-806e-44fe880dbb6d from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:25:51 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Image download 20.69 MB at 20.69 MB/s Jul 07 09:25:51 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e1d4c9-9d1c-4801-8328-d7919e2f6581]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:51 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info Jul 07 09:25:51 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:51 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD Jul 07 09:25:51 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:52 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info" returned: 0 in 0.704s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:52 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info is being set with open permissions: ugo+rw Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:52 devstack sudo[102483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info Jul 07 09:25:52 devstack sudo[102483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:52 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD" returned: 0 in 0.794s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 is fetched for user bb9c5c8e9c93430487b0dc205b985d18. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbb979c-ff99-4c10-959a-57a5b3226515]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:52 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD Jul 07 09:25:52 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:52 devstack sudo[102483]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.info" returned: 0 in 0.808s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.940s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f4495989-41ac-4a9a-9a2d-81ed8fd362ab tempest-VolumesSnapshotTestJSON-1591342045 None] Create snapshot completed successfully Jul 07 09:25:53 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD" returned: 0 in 0.861s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1002298902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fce34dea-105a-4b7e-806e-44fe880dbb6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:51Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Creating volume fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:53 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:25:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:53 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d 1073741824 Jul 07 09:25:53 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:25:54 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d 1073741824" returned: 0 in 0.948s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (e5516d45-97d4-4a45-b5eb-45b375d52014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c1abc9-603d-4e71-8548-0e1ba1ff9efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68c1abc9-603d-4e71-8548-0e1ba1ff9efb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1611297296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:25:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e28cfedd-1918-45e7-860d-822461c85d77,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:25:54Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67db4de3-e413-4a5f-be86-18c3d95ca52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67db4de3-e413-4a5f-be86-18c3d95ca52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4466a082-5285-47f3-a87b-edcf20bbb8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4466a082-5285-47f3-a87b-edcf20bbb8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2', 'volume_name': 'volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2', 'volume_size': 2, 'snapshot_id': 'e28cfedd-1918-45e7-860d-822461c85d77'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d48456-324d-4636-a7c6-4e848916c966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d48456-324d-4636-a7c6-4e848916c966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e08fd6-e05a-4a68-8a17-e13121258dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:25:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Volume 4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2', 'volume_size': 2, 'snapshot_id': 'e28cfedd-1918-45e7-860d-822461c85d77'} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:54 devstack sudo[102505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:25:54 devstack sudo[102505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:55 devstack sudo[102505]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 0 in 0.772s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.786s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-e28cfedd-1918-45e7-860d-822461c85d77-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-e28cfedd-1918-45e7-860d-822461c85d77-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Creating volume 4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 from snapshot e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Attempting download of 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume fce34dea-105a-4b7e-806e-44fe880dbb6d. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] snapshot: e28cfedd-1918-45e7-860d-822461c85d77, volume: 4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[52920c14-e6d4-449b-b08f-ba26bf113e61]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9211c43e-019a-4007-80bc-8b439525c1eb]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:55 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 Jul 07 09:25:55 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:55 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3 Jul 07 09:25:55 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:56 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77" returned: 0 in 0.845s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c91f4f1a-442e-498c-825a-d46718b34d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:25:56 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3" returned: 0 in 0.827s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fed0705-acc7-4148-b3f9-1cc89bbaa17a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:56 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3 Jul 07 09:25:56 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:56 devstack sudo[102539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:25:56 devstack sudo[102539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:56 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3" returned: 1 in 0.762s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_k9xp7_z3' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b0975-452c-4b65-bb62-5e2f25fa66b7]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:56 devstack sudo[102539]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 0.809s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:25:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:56 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 Jul 07 09:25:56 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:56 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD Jul 07 09:25:56 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:25:57 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Jul 07 09:25:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:25:57 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 was qcow2, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:25:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:25:57 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:25:57 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-d0480ec9-b392-49a4-9aa0-515fa38beddf-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Lock "cinder-d0480ec9-b392-49a4-9aa0-515fa38beddf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-quobyte-d0480ec9-b392-49a4-9aa0-515fa38beddf" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-d0480ec9-b392-49a4-9aa0-515fa38beddf" acquired by "delete_volume" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:00 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac407dd2-4a12-428f-b9b3-e7f74674e62b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:01 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf Jul 07 09:26:01 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:02 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 0 in 4.601s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_vgvvdkzwdevstack@QuobyteHD, size 112.00 MB, duration 4.60 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:26:02 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Converted 112.00 MB image at 24.32 MB/s Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:02 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d 1G Jul 07 09:26:02 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:02 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf" returned: 0 in 1.473s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:02 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf Jul 07 09:26:02 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:02 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" returned: 0 in 5.485s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[07640882-8708-4854-a580-bcb6e1852750]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:02 devstack sudo[102582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:26:02 devstack sudo[102582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:02 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d 1G" returned: 0 in 0.740s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[93419f8d-2e48-4983-b458-0dd6b7224cb5]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:03 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d0480ec9-b392-49a4-9aa0-515fa38beddf" returned: 0 in 0.711s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-d0480ec9-b392-49a4-9aa0-515fa38beddf" released by "delete_volume" :: held 2.262s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Created reservations ['6b6f4385-bef3-42eb-89c3-30981401f954', 'eaaa8524-eb74-4f41-bd27-31af3908586a', 'e47ac61b-19aa-4663-b644-973eeb482b55', '8d71d4db-65bf-4a9b-9147-4e20cd3c7a90'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:03 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:26:03 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:03 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:03 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:03 devstack sudo[102582]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 1.015s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:26:03 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Converted 1024.00 MB image at 186.64 MB/s Jul 07 09:26:03 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 is being set with open permissions: ugo+rw Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:03 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 Jul 07 09:26:03 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:03 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.657s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:03 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Deleted volume successfully. Jul 07 09:26:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c3aaa18b-15f2-411e-adff-ced28b7e931b tempest-TestStampPattern-1907711172 None] Lock "cinder-d0480ec9-b392-49a4-9aa0-515fa38beddf-delete_volume" released by "delete_volume" :: held 3.271s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:03 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:26:03 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:04 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" returned: 0 in 0.706s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" released by "_copy_volume_from_snapshot" :: held 8.991s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-e28cfedd-1918-45e7-860d-822461c85d77-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" released by "_create_volume_from_snapshot" :: held 9.037s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.070s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e08fd6-e05a-4a68-8a17-e13121258dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2', 'volume_size': 2, 'snapshot_id': 'e28cfedd-1918-45e7-860d-822461c85d77'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57e1c8a-4e20-41eb-97f8-852c4047427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Volume volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 (4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2): created successfully Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57e1c8a-4e20-41eb-97f8-852c4047427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (e5516d45-97d4-4a45-b5eb-45b375d52014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-536e8dea-c80e-45f3-9032-58a6c04ae4fe tempest-VolumesSnapshotTestJSON-1591342045 None] Created volume successfully. Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-1cabc517-2606-44f4-a49c-12de1c653e2c-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Lock "cinder-1cabc517-2606-44f4-a49c-12de1c653e2c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-quobyte-7ebd8b36-6707-444a-a279-8ce7e8adfb57" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-7ebd8b36-6707-444a-a279-8ce7e8adfb57" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-quobyte-1cabc517-2606-44f4-a49c-12de1c653e2c" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-1cabc517-2606-44f4-a49c-12de1c653e2c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Deleting offline snapshot 1cabc517-2606-44f4-a49c-12de1c653e2c of volume 7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] snapshot_file for this snap is: volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdc3a0d-c9bf-4cd8-8619-52c8d32e63ce]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:04 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c Jul 07 09:26:04 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:04 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 1 in 0.775s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Downloaded image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume fce34dea-105a-4b7e-806e-44fe880dbb6d successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 for user bb9c5c8e9c93430487b0dc205b985d18 is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Marking volume fce34dea-105a-4b7e-806e-44fe880dbb6d as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Copying metadata from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 to fce34dea-105a-4b7e-806e-44fe880dbb6d. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Creating volume glance metadata for volume fce34dea-105a-4b7e-806e-44fe880dbb6d backed by image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb57eb98-d3ce-4b67-a935-5ca1c4ad2def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fce34dea-105a-4b7e-806e-44fe880dbb6d', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fa46f8-88ce-483d-9ee1-603075fb9304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Volume volume-fce34dea-105a-4b7e-806e-44fe880dbb6d (fce34dea-105a-4b7e-806e-44fe880dbb6d): created successfully Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40fa46f8-88ce-483d-9ee1-603075fb9304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (2ce29be8-92dd-4a5e-a6e3-4b21b3a66011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:04 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1501ffbb-5373-49b4-952a-5ca86e1d2ac1 tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:05 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c" returned: 0 in 0.803s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f81d71-99e2-4e1b-805c-3b1a56808cdc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9fb56f-4b03-4cda-99c8-29192c7e4e65]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:05 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:26:05 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:05 devstack sudo[102613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 Jul 07 09:26:05 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (3a6b94c1-00cd-4c18-bc1c-b36bde46a2d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be54b159-8ed2-44ff-a770-0bbeb8cb732a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be54b159-8ed2-44ff-a770-0bbeb8cb732a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1508595067',display_name='tempest-VolumesGetTest-Volume-286904318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a16554-862b-4d5c-be4d-57726a552f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:06Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e335fe-1d4f-4432-8553-a19c9b7d69c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e335fe-1d4f-4432-8553-a19c9b7d69c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf5633c-84e0-49b4-9c4f-c908fd770b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbf5633c-84e0-49b4-9c4f-c908fd770b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53a16554-862b-4d5c-be4d-57726a552f6b', 'volume_name': 'volume-53a16554-862b-4d5c-be4d-57726a552f6b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec22f520-c97f-4e7c-a9e1-e63bfb75b6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec22f520-c97f-4e7c-a9e1-e63bfb75b6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8205bab7-94aa-4652-9e37-bec28ba1643c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Volume 53a16554-862b-4d5c-be4d-57726a552f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53a16554-862b-4d5c-be4d-57726a552f6b', 'volume_size': 1} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1508595067',display_name='tempest-VolumesGetTest-Volume-286904318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53a16554-862b-4d5c-be4d-57726a552f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1d7089467584462b827cc2596d3ee5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:06Z,use_quota=True,user_id='bb9c5c8e9c93430487b0dc205b985d18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Creating volume 53a16554-862b-4d5c-be4d-57726a552f6b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:05 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:05 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b 1073741824 Jul 07 09:26:05 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:06 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 0.810s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:06 devstack sudo[102624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c Jul 07 09:26:06 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:06 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:06 devstack sudo[102626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2 Jul 07 09:26:06 devstack sudo[102626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:06 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b 1073741824" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:06 devstack sudo[102631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b Jul 07 09:26:06 devstack sudo[102631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:06 devstack sudo[102626]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" returned: 0 in 0.692s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2" released by "delete_volume" :: held 1.544s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:06 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c" returned: 0 in 0.793s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:06 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c Jul 07 09:26:06 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:06 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['938239a3-367d-477c-9c41-98dd20b26197', '396ce12e-b904-4d40-a654-2f1144bb31be', '713bacf3-9447-4532-a40a-b799033088fb', '0b577261-17fb-4a39-82fb-41b0c797a325'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:07 devstack sudo[102639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:07 devstack sudo[102639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:07 devstack sudo[102631]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b" returned: 0 in 0.656s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8205bab7-94aa-4652-9e37-bec28ba1643c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53a16554-862b-4d5c-be4d-57726a552f6b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bd3e74-a869-4bf5-9d4d-68c622ae90bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:07 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Volume volume-53a16554-862b-4d5c-be4d-57726a552f6b (53a16554-862b-4d5c-be4d-57726a552f6b): created successfully Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bd3e74-a869-4bf5-9d4d-68c622ae90bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Flow 'volume_create_manager' (3a6b94c1-00cd-4c18-bc1c-b36bde46a2d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2b135a0f-1fe9-4968-95dd-5fb5ee047dcd tempest-VolumesGetTest-201428079 None] Created volume successfully. Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-e28cfedd-1918-45e7-860d-822461c85d77-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-e28cfedd-1918-45e7-860d-822461c85d77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-c91f4f1a-442e-498c-825a-d46718b34d32" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-c91f4f1a-442e-498c-825a-d46718b34d32" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-e28cfedd-1918-45e7-860d-822461c85d77" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-e28cfedd-1918-45e7-860d-822461c85d77" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Deleting offline snapshot e28cfedd-1918-45e7-860d-822461c85d77 of volume c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] snapshot_file for this snap is: volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[753e7b4b-208b-4e01-a752-838536ed19c4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:07 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57.1cabc517-2606-44f4-a49c-12de1c653e2c" returned: 0 in 0.746s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-1cabc517-2606-44f4-a49c-12de1c653e2c" released by "_delete_snapshot" :: held 3.278s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-7ebd8b36-6707-444a-a279-8ce7e8adfb57" released by "delete_snapshot" :: held 3.305s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:07 devstack sudo[102639]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.730s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:07 devstack sudo[102644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 Jul 07 09:26:07 devstack sudo[102644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Deleted volume successfully. Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Created reservations ['0f1e6e3a-51e4-47c4-b3cb-f025dff9ca70', 'de68ea8c-49ea-4176-b909-796684aedf07', '300196d5-b061-40ec-b41a-47ff3fd56549', '5677509b-2846-4da7-b08e-828364c5b904'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4a5dee36-4b01-4965-b0ec-8fd052bfac2a tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-4385a8c2-2e74-4f0f-8e6e-ac2fa6a3edc2-delete_volume" released by "delete_volume" :: held 2.578s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-53a16554-862b-4d5c-be4d-57726a552f6b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Lock "cinder-53a16554-862b-4d5c-be4d-57726a552f6b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Delete snapshot completed successfully. Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7379db97-c40d-40ab-9a67-a2289e6e90f8 tempest-TestStampPattern-1907711172 None] Lock "cinder-1cabc517-2606-44f4-a49c-12de1c653e2c-delete_snapshot" released by "delete_snapshot" :: held 3.498s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-53a16554-862b-4d5c-be4d-57726a552f6b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-53a16554-862b-4d5c-be4d-57726a552f6b" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[678659e6-f110-44a6-8801-b4736d43a326]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:08 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b Jul 07 09:26:08 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:08 devstack sudo[102644]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c91f4f1a-442e-498c-825a-d46718b34d32(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[879d2a26-bf02-4209-96c8-fb98ad2dc697]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:08 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:26:08 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:08 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b" returned: 0 in 0.804s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:08 devstack sudo[102658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b Jul 07 09:26:08 devstack sudo[102658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:09 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 0.813s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:09 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 Jul 07 09:26:09 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:09 devstack sudo[102658]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-53a16554-862b-4d5c-be4d-57726a552f6b" returned: 0 in 0.731s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-53a16554-862b-4d5c-be4d-57726a552f6b" released by "delete_volume" :: held 1.583s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Created reservations ['1c5f45f3-b900-4966-86b9-aa2b74a2f3df', '89fb98cc-9d2b-4bd1-b049-f41dbd545301', '9cce3de6-f7d5-4231-84cb-5d711ea79507', 'd09905b7-a0d7-4de0-abcc-2079c69d9875'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:09 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:09 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:10 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77" returned: 0 in 0.855s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:10 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77 Jul 07 09:26:10 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-fce34dea-105a-4b7e-806e-44fe880dbb6d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Lock "cinder-fce34dea-105a-4b7e-806e-44fe880dbb6d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Acquiring lock "cinder-quobyte-fce34dea-105a-4b7e-806e-44fe880dbb6d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-fce34dea-105a-4b7e-806e-44fe880dbb6d" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f177f308-7ffd-4cdb-b6bb-975b0b1ae8c6]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:10 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.819s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b92dbe85-0f41-4680-b43c-b5139d163c68 tempest-VolumesGetTest-201428079 None] Lock "cinder-53a16554-862b-4d5c-be4d-57726a552f6b-delete_volume" released by "delete_volume" :: held 2.659s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:10 devstack sudo[102676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:26:10 devstack sudo[102676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:10 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32.e28cfedd-1918-45e7-860d-822461c85d77" returned: 0 in 0.836s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-e28cfedd-1918-45e7-860d-822461c85d77" released by "_delete_snapshot" :: held 3.450s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-c91f4f1a-442e-498c-825a-d46718b34d32" released by "delete_snapshot" :: held 3.490s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['38032f06-655d-4557-9b2f-d802e4ddce72', '040a9e8b-1668-4ea2-a3c1-59d007de9371', '5475c171-7d3d-4973-b59d-06d7a6b347fc', 'f4d00ecf-85ca-4ab5-8837-55f91203368f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Delete snapshot completed successfully. Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e08e000a-eadd-4101-96ec-14322f5b2a96 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-e28cfedd-1918-45e7-860d-822461c85d77-delete_snapshot" released by "delete_snapshot" :: held 3.647s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:11 devstack sudo[102676]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 0 in 0.802s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:11 devstack sudo[102687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:26:11 devstack sudo[102687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-c91f4f1a-442e-498c-825a-d46718b34d32-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-c91f4f1a-442e-498c-825a-d46718b34d32-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-c91f4f1a-442e-498c-825a-d46718b34d32" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-c91f4f1a-442e-498c-825a-d46718b34d32" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[432c26c9-eb53-473d-b6e7-d303984d610a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:12 devstack sudo[102687]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 1 in 0.910s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:12 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:26:12 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:12 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d Jul 07 09:26:12 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:12 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-fce34dea-105a-4b7e-806e-44fe880dbb6d" returned: 0 in 0.728s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Lock "cinder-quobyte-fce34dea-105a-4b7e-806e-44fe880dbb6d" released by "delete_volume" :: held 2.517s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:DELETE=8,cinder:SELECT=104,cinder:INSERT=32,cinder:UPDATE=99 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=98,cinder:INSERT=32,cinder:UPDATE=110,cinder:DELETE=10 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:26:12 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 0.877s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:12 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32 Jul 07 09:26:12 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:12 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Created reservations ['6307787a-a7f2-4312-8b91-ff11fca5c042', 'af5e8c2b-1959-4944-a68c-5090b0efe4f9', '23e31fff-5c1f-41f8-a0ed-37f10b017cd5', '9376a00a-4c57-4e29-a0b4-b0771ba46ed7'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:13 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:13 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:13 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c91f4f1a-442e-498c-825a-d46718b34d32" returned: 0 in 0.663s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-c91f4f1a-442e-498c-825a-d46718b34d32" released by "delete_volume" :: held 1.620s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['0dd60364-8173-4f2c-9ba6-30633aa1d5a6', 'e45140bc-3cb8-4ab2-9bea-bcd66835646f', '61e6dc5a-9094-42f3-8063-053a34bb54fc', '5abbc7bc-c858-4ff0-8e87-e25c2d891164'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:13 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Deleted volume successfully. Jul 07 09:26:13 devstack sudo[102725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:13 devstack sudo[102725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cee27c60-d992-4ab7-9aa8-a15d1e4fcc30 tempest-VolumesGetTest-201428079 None] Lock "cinder-fce34dea-105a-4b7e-806e-44fe880dbb6d-delete_volume" released by "delete_volume" :: held 3.569s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:14 devstack sudo[102725]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.747s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Deleted volume successfully. Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-025ae6a4-eb9a-4006-9519-e0a8b1fd72ef tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-c91f4f1a-442e-498c-825a-d46718b34d32-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (e3619334-5255-41f6-97e5-eea71cdf449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521119f7-bfbd-497d-8e71-87647bc37f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521119f7-bfbd-497d-8e71-87647bc37f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1746260314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd8114f-83f7-40d4-b831-fdec5cd34103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:15Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaa9b01-a62b-4845-94da-da2822f10114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaa9b01-a62b-4845-94da-da2822f10114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884d2a67-9f0a-49b3-b097-4d9e2843b762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (884d2a67-9f0a-49b3-b097-4d9e2843b762) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd8114f-83f7-40d4-b831-fdec5cd34103', 'volume_name': 'volume-6bd8114f-83f7-40d4-b831-fdec5cd34103', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fedea98-8ef0-470d-bcc6-756a05c32867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fedea98-8ef0-470d-bcc6-756a05c32867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9aa3420-efc8-4cac-883c-a5566d1518d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:14 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Volume 6bd8114f-83f7-40d4-b831-fdec5cd34103: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd8114f-83f7-40d4-b831-fdec5cd34103', 'volume_size': 1} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1746260314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd8114f-83f7-40d4-b831-fdec5cd34103,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:15Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Creating volume 6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:14 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:14 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 1073741824 Jul 07 09:26:14 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:15 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 1073741824" returned: 0 in 0.938s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:15 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:15 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:16 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.658s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9aa3420-efc8-4cac-883c-a5566d1518d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd8114f-83f7-40d4-b831-fdec5cd34103', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b81bdd-f597-47e8-8a13-a691027c5a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:16 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Volume volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 (6bd8114f-83f7-40d4-b831-fdec5cd34103): created successfully Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b81bdd-f597-47e8-8a13-a691027c5a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (e3619334-5255-41f6-97e5-eea71cdf449a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-21c622ee-d3e8-4fd3-8d5b-2cf085c7a770 tempest-VolumesSnapshotTestJSON-1591342045 None] Created volume successfully. Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Flow 'volume_create_manager' (26bd38a6-f16a-4d03-a52b-f56b21cbbf81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473c3dc1-3cce-4dce-8716-4a6d01b4c8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473c3dc1-3cce-4dce-8716-4a6d01b4c8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1230890794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fd705e01cb48c0a4c59fc03724e9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:17Z,use_quota=True,user_id='55bb18abef84464fae57b518e8f5bf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fd0545-7dc3-4498-8fcb-b4298a3a1aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fd0545-7dc3-4498-8fcb-b4298a3a1aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a458af15-4a4d-41ec-b1ed-980e776f1ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a458af15-4a4d-41ec-b1ed-980e776f1ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e', 'volume_name': 'volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a907337-7bed-4ede-a164-d9e06ba39898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a907337-7bed-4ede-a164-d9e06ba39898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba19b6-21cb-4a3d-948e-ebdbd4c4d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:16 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e', 'volume_size': 1} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1230890794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45fd705e01cb48c0a4c59fc03724e9c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:17Z,use_quota=True,user_id='55bb18abef84464fae57b518e8f5bf0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Creating volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:16 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:16 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e 1073741824 Jul 07 09:26:16 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-7ebd8b36-6707-444a-a279-8ce7e8adfb57-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Lock "cinder-7ebd8b36-6707-444a-a279-8ce7e8adfb57-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Acquiring lock "cinder-quobyte-7ebd8b36-6707-444a-a279-8ce7e8adfb57" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-7ebd8b36-6707-444a-a279-8ce7e8adfb57" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2482dc-590e-44d9-a24c-deedad189d35]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:17 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:26:17 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:17 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e 1073741824" returned: 0 in 0.898s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:17 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e Jul 07 09:26:17 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:18 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 0.786s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:18 devstack sudo[102751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57 Jul 07 09:26:18 devstack sudo[102751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:18 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" returned: 0 in 0.670s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.409s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ba19b6-21cb-4a3d-948e-ebdbd4c4d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df809237-ed2e-4c00-a214-817b5326698e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Creating offline snapshot 4dbfb4ee-2a34-4997-ae1d-27ca58711808 of volume 6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:26:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Volume volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e (ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e): created successfully Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df809237-ed2e-4c00-a214-817b5326698e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Flow 'volume_create_manager' (26bd38a6-f16a-4d03-a52b-f56b21cbbf81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10dbb50-2e79-4558-a80d-a21703c3370a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-787f0d9f-042a-4cad-9be1-5c36a88939b4 tempest-VolumesSnapshotListTestJSON-106317106 None] Created volume successfully. Jul 07 09:26:18 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:18 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:18 devstack sudo[102751]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ebd8b36-6707-444a-a279-8ce7e8adfb57" returned: 0 in 0.687s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Lock "cinder-quobyte-7ebd8b36-6707-444a-a279-8ce7e8adfb57" released by "delete_volume" :: held 1.557s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:18 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Created reservations ['7eb8282a-892f-4455-9cb0-3a59e58be64e', '3b9f18ec-2558-4dd9-ac00-e562ce814bd6', 'f024436a-d5ad-42c7-809e-ab86e6881d9f', '54ec0927-0fd1-44d2-a9fc-48f3b345ddeb'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:19 devstack sudo[102758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:19 devstack sudo[102758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:19 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.788s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:19 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 1G Jul 07 09:26:19 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:19 devstack sudo[102758]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.715s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:19 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Deleted volume successfully. Jul 07 09:26:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed4bddf9-7688-4d75-873d-edef166f2c15 tempest-TestStampPattern-1907711172 None] Lock "cinder-7ebd8b36-6707-444a-a279-8ce7e8adfb57-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:20 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 1G" returned: 0 in 0.849s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:20 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 Jul 07 09:26:20 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:20 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808" returned: 0 in 0.710s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:20 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 is being set with open permissions: ugo+rw Jul 07 09:26:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:20 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 Jul 07 09:26:20 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:21 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808" returned: 0 in 0.662s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:21 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info Jul 07 09:26:21 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:22 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info" returned: 0 in 0.671s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:22 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info is being set with open permissions: ugo+rw Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:22 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info Jul 07 09:26:22 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:22 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.info" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.523s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.928s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Creating offline snapshot bd2a0e83-20b8-45e4-8aa3-eb557994cce1 of volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[feceaaa1-16c7-4e98-b2cd-e10837d31d0f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2f399405-351e-4d48-9573-a48a099c4ff1 tempest-VolumesSnapshotTestJSON-1591342045 None] Create snapshot completed successfully Jul 07 09:26:22 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e Jul 07 09:26:22 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:23 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" returned: 0 in 0.953s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:23 devstack sudo[102790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 1G Jul 07 09:26:23 devstack sudo[102790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (2f14b409-e5c7-4e6d-90ab-58729234b750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfd3e9d-ca1b-458f-9812-630fe283f44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbfd3e9d-ca1b-458f-9812-630fe283f44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1016932440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=609e4c20-cf8b-4519-8c80-1ed23342596b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b76f6c2b7b7449a2bdbced24a2c8335d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4dbfb4ee-2a34-4997-ae1d-27ca58711808,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:24Z,use_quota=True,user_id='edcc3835b0aa48798815019fd39c6221',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fc0147-f6e9-4c1e-8b52-c59ab35fc1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6fc0147-f6e9-4c1e-8b52-c59ab35fc1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10e41d5-6733-4cb5-ac3f-77de5075515e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10e41d5-6733-4cb5-ac3f-77de5075515e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '609e4c20-cf8b-4519-8c80-1ed23342596b', 'volume_name': 'volume-609e4c20-cf8b-4519-8c80-1ed23342596b', 'volume_size': 1, 'snapshot_id': '4dbfb4ee-2a34-4997-ae1d-27ca58711808'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6decc5-6621-4fe3-b0d5-0c2c8d6805d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e6decc5-6621-4fe3-b0d5-0c2c8d6805d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0809c83-fb47-41bb-be3c-63a37e411e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:23 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Volume 609e4c20-cf8b-4519-8c80-1ed23342596b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-609e4c20-cf8b-4519-8c80-1ed23342596b', 'volume_size': 1, 'snapshot_id': '4dbfb4ee-2a34-4997-ae1d-27ca58711808'} Jul 07 09:26:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:24 devstack sudo[102790]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 1G" returned: 0 in 0.846s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:24 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:24 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:25 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.735s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:25 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 is being set with open permissions: ugo+rw Jul 07 09:26:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:25 devstack sudo[102801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:25 devstack sudo[102801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:26 devstack sudo[102801]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.663s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:26 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info Jul 07 09:26:26 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:26 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info" returned: 0 in 0.739s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:26 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info is being set with open permissions: ugo+rw Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:26 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info Jul 07 09:26:26 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:27 devstack sudo[102809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:27 devstack sudo[102809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:27 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.info" returned: 0 in 0.729s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.777s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.623s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-4dbfb4ee-2a34-4997-ae1d-27ca58711808-609e4c20-cf8b-4519-8c80-1ed23342596b" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4dbfb4ee-2a34-4997-ae1d-27ca58711808-609e4c20-cf8b-4519-8c80-1ed23342596b" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Creating volume 609e4c20-cf8b-4519-8c80-1ed23342596b from snapshot 4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-609e4c20-cf8b-4519-8c80-1ed23342596b" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d7c1ba53-4d9a-4e59-8935-d40c0520d699 tempest-VolumesSnapshotListTestJSON-106317106 None] Create snapshot completed successfully Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-609e4c20-cf8b-4519-8c80-1ed23342596b" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] snapshot: 4dbfb4ee-2a34-4997-ae1d-27ca58711808, volume: 609e4c20-cf8b-4519-8c80-1ed23342596b, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:26:27 devstack sudo[102809]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c81c9ca-3252-4ff1-b511-bc27a6de3e80]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:27 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 Jul 07 09:26:27 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:28 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808" returned: 0 in 0.852s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bd8114f-83f7-40d4-b831-fdec5cd34103(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0136db5d-ad94-476c-a1e9-88e25feacb6e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:28 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:28 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:29 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:29 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:26:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:29 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b Jul 07 09:26:29 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:31 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:31 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (56366dd9-ebf0-473e-836d-c88022e06361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5d6854-caf1-46b9-95a9-8aabc460ee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5d6854-caf1-46b9-95a9-8aabc460ee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30869344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90394c2e-e14e-43ff-9307-e755c3ecdd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:32Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2287bd5-8069-4fdb-a08d-a196dc54c11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2287bd5-8069-4fdb-a08d-a196dc54c11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547abd78-b2f9-4810-8d20-e0dc151adee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (547abd78-b2f9-4810-8d20-e0dc151adee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90394c2e-e14e-43ff-9307-e755c3ecdd57', 'volume_name': 'volume-90394c2e-e14e-43ff-9307-e755c3ecdd57', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc4a634-108e-4616-8b5b-a9439a979777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdc4a634-108e-4616-8b5b-a9439a979777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24ae72c-0629-40e2-b0a7-a5df239cc726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:32 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume 90394c2e-e14e-43ff-9307-e755c3ecdd57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90394c2e-e14e-43ff-9307-e755c3ecdd57', 'volume_size': 1} Jul 07 09:26:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:34 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b" returned: 0 in 4.924s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf1c59d-21fc-42bd-91b9-c61d22a41abb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:34 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:34 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:35 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.891s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103, size 1024.00 MB, duration 4.93 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:26:35 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Converted 1024.00 MB image at 207.91 MB/s Jul 07 09:26:35 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b is being set with open permissions: ugo+rw Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:35 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b Jul 07 09:26:35 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:35 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b" returned: 0 in 0.634s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-609e4c20-cf8b-4519-8c80-1ed23342596b" released by "_copy_volume_from_snapshot" :: held 8.190s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4dbfb4ee-2a34-4997-ae1d-27ca58711808-609e4c20-cf8b-4519-8c80-1ed23342596b" released by "_create_volume_from_snapshot" :: held 8.232s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.276s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.409s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Creating offline snapshot 60508861-052d-4fee-a378-2c385b9914dc of volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0809c83-fb47-41bb-be3c-63a37e411e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-609e4c20-cf8b-4519-8c80-1ed23342596b', 'volume_size': 1, 'snapshot_id': '4dbfb4ee-2a34-4997-ae1d-27ca58711808'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c4b086-ded9-4fa5-8db6-78f85df934ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[939db339-9109-476e-85a7-3c381c94ae90]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Volume volume-609e4c20-cf8b-4519-8c80-1ed23342596b (609e4c20-cf8b-4519-8c80-1ed23342596b): created successfully Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51c4b086-ded9-4fa5-8db6-78f85df934ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Flow 'volume_create_manager' (2f14b409-e5c7-4e6d-90ab-58729234b750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d4d1faa6-760a-4bef-b9e8-75e8a0befe3d tempest-VolumesSnapshotTestJSON-1591342045 None] Created volume successfully. Jul 07 09:26:36 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:36 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:36 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:36 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc 1G Jul 07 09:26:36 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-609e4c20-cf8b-4519-8c80-1ed23342596b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-609e4c20-cf8b-4519-8c80-1ed23342596b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-609e4c20-cf8b-4519-8c80-1ed23342596b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-609e4c20-cf8b-4519-8c80-1ed23342596b" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[be742483-e20b-43ee-8d21-2c4f0b6643b4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:37 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b Jul 07 09:26:37 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:37 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc 1G" returned: 0 in 0.844s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:37 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:37 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:37 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b" returned: 0 in 0.780s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:37 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b Jul 07 09:26:37 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:38 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:38 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc is being set with open permissions: ugo+rw Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:38 devstack sudo[102870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:38 devstack sudo[102870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:38 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-609e4c20-cf8b-4519-8c80-1ed23342596b" returned: 0 in 0.666s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-609e4c20-cf8b-4519-8c80-1ed23342596b" released by "delete_volume" :: held 1.485s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['80702ec0-5011-4b27-a4cb-7b0a9a9ef596', '76215785-a283-4f6e-a939-db0bd1f34268', 'fe293a5d-129d-46b2-be5e-9783c2da6aea', '086ae45e-16db-4604-9c61-eeafdb284223'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:38 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:38 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:38 devstack sudo[102870]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 0.651s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.085s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.709s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30869344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90394c2e-e14e-43ff-9307-e755c3ecdd57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:32Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating volume 90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:38 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:39 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 1073741824 Jul 07 09:26:39 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-45da878c-73c7-448a-b27d-57395e945e86 tempest-VolumesSnapshotListTestJSON-106317106 None] Create snapshot completed successfully Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-4dbfb4ee-2a34-4997-ae1d-27ca58711808-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-4dbfb4ee-2a34-4997-ae1d-27ca58711808-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-6bd8114f-83f7-40d4-b831-fdec5cd34103" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-6bd8114f-83f7-40d4-b831-fdec5cd34103" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-4dbfb4ee-2a34-4997-ae1d-27ca58711808" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:39 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.699s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Deleted volume successfully. Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4dbfb4ee-2a34-4997-ae1d-27ca58711808" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Deleting offline snapshot 4dbfb4ee-2a34-4997-ae1d-27ca58711808 of volume 6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] snapshot_file for this snap is: volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bef1b9-6b42-482d-8b50-3b46e1b192c8]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a5d6adb-a225-442d-a6fb-9ab73422c5c9 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-609e4c20-cf8b-4519-8c80-1ed23342596b-delete_volume" released by "delete_volume" :: held 2.429s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:39 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 Jul 07 09:26:39 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:39 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 1073741824" returned: 0 in 0.881s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:39 devstack sudo[102884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 Jul 07 09:26:39 devstack sudo[102884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:40 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808" returned: 0 in 0.784s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bd8114f-83f7-40d4-b831-fdec5cd34103(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf077f2-0e11-4dbb-b00f-dd7c58138b4b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:40 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:40 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:40 devstack sudo[102884]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57" returned: 0 in 0.732s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.399s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Creating offline snapshot 7af01b6a-00ab-43ae-9737-27d278c55010 of volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f24ae72c-0629-40e2-b0a7-a5df239cc726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90394c2e-e14e-43ff-9307-e755c3ecdd57', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9d1b15-7ae4-4cbd-94d9-fe1f9040bf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2fb3ae-3eb6-430f-80f9-a7032c9d10e3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:40 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 (90394c2e-e14e-43ff-9307-e755c3ecdd57): created successfully Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e9d1b15-7ae4-4cbd-94d9-fe1f9040bf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (56366dd9-ebf0-473e-836d-c88022e06361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:40 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2106130e-764d-4c2d-9b19-3bc4d9d91a4e tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created volume successfully. Jul 07 09:26:40 devstack sudo[102928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:40 devstack sudo[102928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:41 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.813s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:41 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 Jul 07 09:26:41 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:41 devstack sudo[102928]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 0.847s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:41 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 1G Jul 07 09:26:41 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:41 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:41 devstack sudo[102944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808 Jul 07 09:26:41 devstack sudo[102944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:42 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 1G" returned: 0 in 0.852s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:42 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 Jul 07 09:26:42 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:42 devstack sudo[102944]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103.4dbfb4ee-2a34-4997-ae1d-27ca58711808" returned: 0 in 0.676s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-4dbfb4ee-2a34-4997-ae1d-27ca58711808" released by "_delete_snapshot" :: held 3.219s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-6bd8114f-83f7-40d4-b831-fdec5cd34103" released by "delete_snapshot" :: held 3.247s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['b5db926c-bd7c-4086-86c2-1513f8711d09', '73087bcf-e704-41d2-b878-66c7979bf7f9', 'cdaf1e5f-bb93-4d1b-97c9-40f8b91efdd4', '1dac927b-8949-45c4-8d20-2c0d70096b4a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Delete snapshot completed successfully. Jul 07 09:26:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f87b6033-ab2c-4b67-b29c-3868cd593cb7 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-4dbfb4ee-2a34-4997-ae1d-27ca58711808-delete_snapshot" released by "delete_snapshot" :: held 3.384s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:43 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010" returned: 0 in 0.704s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:43 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 is being set with open permissions: ugo+rw Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:43 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 Jul 07 09:26:43 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-6bd8114f-83f7-40d4-b831-fdec5cd34103-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-6bd8114f-83f7-40d4-b831-fdec5cd34103-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-6bd8114f-83f7-40d4-b831-fdec5cd34103" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-6bd8114f-83f7-40d4-b831-fdec5cd34103" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[12753dfb-c973-411d-a78d-08dee5cf92cb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:43 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010" returned: 0 in 0.664s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.173s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.279s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:43 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:43 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating offline snapshot 8fd0310a-e0eb-4681-8b83-f17d4815c0b4 of volume 90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:26:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-af26aebc-5764-4dbe-9091-a606072148c1 tempest-VolumesSnapshotListTestJSON-106317106 None] Create snapshot completed successfully Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[771a63d1-5e3e-4609-b684-6551f2e62b04]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:43 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 Jul 07 09:26:43 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:44 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.815s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:44 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103 Jul 07 09:26:44 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:44 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57" returned: 0 in 0.860s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:44 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 1G Jul 07 09:26:44 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:45 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd8114f-83f7-40d4-b831-fdec5cd34103" returned: 0 in 0.702s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-6bd8114f-83f7-40d4-b831-fdec5cd34103" released by "delete_volume" :: held 1.580s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-7af01b6a-00ab-43ae-9737-27d278c55010-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-7af01b6a-00ab-43ae-9737-27d278c55010-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-7af01b6a-00ab-43ae-9737-27d278c55010" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-7af01b6a-00ab-43ae-9737-27d278c55010" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Deleting offline snapshot 7af01b6a-00ab-43ae-9737-27d278c55010 of volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] snapshot_file for this snap is: volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['25823917-318d-4dec-9600-7b36bca4f0e1', '4fb5f08e-d738-4897-877e-b1cb60286f79', 'c89a8c28-22ba-4095-a5ec-c38e1b1d5d95', '9ea85831-3725-4bbd-8419-9865764657dc'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e5b7c4-6237-40f2-85c3-f7d164c17a98]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:45 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:45 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:45 devstack sudo[102977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 Jul 07 09:26:45 devstack sudo[102977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:45 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 1G" returned: 0 in 0.902s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:45 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 Jul 07 09:26:45 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "cinder-quobyte-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b7d08a-ec87-4295-b88f-394fb4fa7dfe]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:46 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.719s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Deleted volume successfully. Jul 07 09:26:46 devstack sudo[102988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c Jul 07 09:26:46 devstack sudo[102988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:46 devstack sudo[102977]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0a2edf2a-ab95-4df5-8ecb-f5e96d54d932 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-6bd8114f-83f7-40d4-b831-fdec5cd34103-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010" returned: 0 in 0.841s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a28857-7365-46f5-a4b3-d2e4cbb14c4d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:46 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:46 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:46 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4" returned: 0 in 0.858s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:46 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 is being set with open permissions: ugo+rw Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:46 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 Jul 07 09:26:46 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:46 devstack sudo[102988]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" returned: 0 in 0.809s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:46 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c Jul 07 09:26:46 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:47 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 0.823s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:47 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 Jul 07 09:26:47 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:47 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4" returned: 0 in 0.677s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:47 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info Jul 07 09:26:47 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:47 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" returned: 0 in 0.672s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-quobyte-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c" released by "delete_volume" :: held 1.556s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Created reservations ['778f2b06-dd75-4675-acf7-ed896702d1ac', '835aeef2-9962-4140-9569-6fa531d29507', '411f243a-e76e-4ad7-9653-10d4ee3b106c', 'cf38d17d-0a49-4b6e-9ed7-1450c150d804'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:47 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:26:47 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:47 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info" returned: 0 in 0.674s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:47 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info is being set with open permissions: ugo+rw Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:47 devstack sudo[103024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info Jul 07 09:26:47 devstack sudo[103024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:47 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010" returned: 0 in 0.866s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:47 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010 Jul 07 09:26:47 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:48 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.658s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:26:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Deleted volume successfully. Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-32538529-1d8e-4954-bc9b-d21e41c54202 tempest-VolumesSnapshotTestJSON-1591342045 None] Lock "cinder-b0377b10-e77d-4500-ba4e-d99fc0bbcd2c-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:48 devstack sudo[103024]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.info" returned: 0 in 0.705s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.778s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5ef73a79-79ff-4e3b-b203-d77824de9783 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Create snapshot completed successfully Jul 07 09:26:48 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.7af01b6a-00ab-43ae-9737-27d278c55010" returned: 0 in 0.694s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-7af01b6a-00ab-43ae-9737-27d278c55010" released by "_delete_snapshot" :: held 3.329s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" released by "delete_snapshot" :: held 3.365s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Created reservations ['d4858ee7-4000-4144-9e27-f905f67ad58d', '944be958-0598-4cfb-b7fc-793d2198bb43', '0b2a21d1-ba9c-4264-be94-30d8d6a84665', 'ba099d1f-260b-4c1a-bf05-d03bb1ecc3af'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Delete snapshot completed successfully. Jul 07 09:26:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-270517af-b5b9-4e85-9884-87541e0284f7 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-7af01b6a-00ab-43ae-9737-27d278c55010-delete_snapshot" released by "delete_snapshot" :: held 3.506s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (186b5cab-2d22-40e5-b126-7810535d2b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ccb78d-d1cf-413d-9202-926c96647032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10ccb78d-d1cf-413d-9202-926c96647032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062057319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0526302d-46b1-4399-99bb-4c6f4319416d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:49Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b0f4cc-1a2c-40b5-acd5-c76aba7e852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6b0f4cc-1a2c-40b5-acd5-c76aba7e852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319ec126-d6f2-449e-83ff-e9ea64869cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319ec126-d6f2-449e-83ff-e9ea64869cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0526302d-46b1-4399-99bb-4c6f4319416d', 'volume_name': 'volume-0526302d-46b1-4399-99bb-4c6f4319416d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b62beac-18d2-4b2d-af47-1e3befd1e4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b62beac-18d2-4b2d-af47-1e3befd1e4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d72ae31-9747-4c1b-b4d2-e1ae7d99d109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume 0526302d-46b1-4399-99bb-4c6f4319416d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0526302d-46b1-4399-99bb-4c6f4319416d', 'volume_size': 1} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062057319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0526302d-46b1-4399-99bb-4c6f4319416d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:49Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating volume 0526302d-46b1-4399-99bb-4c6f4319416d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:49 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:49 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d 1073741824 Jul 07 09:26:49 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-60508861-052d-4fee-a378-2c385b9914dc-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-60508861-052d-4fee-a378-2c385b9914dc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-60508861-052d-4fee-a378-2c385b9914dc" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (ad6cc8c3-a595-4967-b50d-a6bb3a4eb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b59390-42e9-4c7a-9163-4e10eb25bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-60508861-052d-4fee-a378-2c385b9914dc" acquired by "_delete_snapshot" :: waited 0.080s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Deleting offline snapshot 60508861-052d-4fee-a378-2c385b9914dc of volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] snapshot_file for this snap is: volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7727e581-57a4-46ef-8437-843a2325714e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b59390-42e9-4c7a-9163-4e10eb25bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135127121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8791db81-29bc-448f-a378-04baa355ba9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:50Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb8eda-a891-4246-adde-9ca58c4e6a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4cb8eda-a891-4246-adde-9ca58c4e6a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297db3d2-cc1c-4765-a7dc-4b3fc60504b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:49 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297db3d2-cc1c-4765-a7dc-4b3fc60504b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8791db81-29bc-448f-a378-04baa355ba9a', 'volume_name': 'volume-8791db81-29bc-448f-a378-04baa355ba9a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94cdc7d-e2b1-4d1f-886c-42f3b32bcb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d94cdc7d-e2b1-4d1f-886c-42f3b32bcb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e263d8-88ca-4b80-91af-0fdced499a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume 8791db81-29bc-448f-a378-04baa355ba9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8791db81-29bc-448f-a378-04baa355ba9a', 'volume_size': 1} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:50 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:50 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (0e1c260f-532b-4cda-ab28-fe4173c1f9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bfd8a1-0359-4d05-9d09-4ef1c078813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25bfd8a1-0359-4d05-9d09-4ef1c078813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434576107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f1e593-a70f-4a18-b199-77b4fe86c63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:50Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b93d6a7-9069-4b12-83e6-3f50bc1b375d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b93d6a7-9069-4b12-83e6-3f50bc1b375d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22140932-182d-4812-8c3a-c6a065e0dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22140932-182d-4812-8c3a-c6a065e0dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f1e593-a70f-4a18-b199-77b4fe86c63a', 'volume_name': 'volume-24f1e593-a70f-4a18-b199-77b4fe86c63a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f85e09c-3dea-408e-bb05-9378d0dffd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f85e09c-3dea-408e-bb05-9378d0dffd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b190269-3ce8-447d-9c6c-a50904c63a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume 24f1e593-a70f-4a18-b199-77b4fe86c63a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f1e593-a70f-4a18-b199-77b4fe86c63a', 'volume_size': 1} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (ccb400be-dfb5-4e74-98fd-9242eae1ea39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6b7c4b-2850-4759-8d07-ec4fe1a9889a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa6b7c4b-2850-4759-8d07-ec4fe1a9889a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1630542059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ab0c63-58ba-4c03-abd7-c583336e708f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:51Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da32d765-56fb-47f5-9ab4-5adfce8100eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da32d765-56fb-47f5-9ab4-5adfce8100eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9375ce93-3bef-4f33-835c-c4cf8846f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9375ce93-3bef-4f33-835c-c4cf8846f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8ab0c63-58ba-4c03-abd7-c583336e708f', 'volume_name': 'volume-b8ab0c63-58ba-4c03-abd7-c583336e708f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf0f50b-1a5a-47d4-abe5-257a5df1e386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cf0f50b-1a5a-47d4-abe5-257a5df1e386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f59aeee-0d74-4500-9155-c0c48988cc42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume b8ab0c63-58ba-4c03-abd7-c583336e708f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8ab0c63-58ba-4c03-abd7-c583336e708f', 'volume_size': 1} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d 1073741824" returned: 0 in 1.431s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:50 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d Jul 07 09:26:50 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:51 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (581af437-5387-44ab-bf76-88664348f52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a78e196-b387-4cdb-b24c-03d6b865d44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 1.274s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a78e196-b387-4cdb-b24c-03d6b865d44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334747475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38973e4-94fc-474d-9e04-f3f01b82c38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:51Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d3b6a-10a3-4b8a-a36e-1dc6d387c886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821d3b6a-10a3-4b8a-a36e-1dc6d387c886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b01a51-1440-4807-b54f-28586a64e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3b01a51-1440-4807-b54f-28586a64e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e38973e4-94fc-474d-9e04-f3f01b82c38a', 'volume_name': 'volume-e38973e4-94fc-474d-9e04-f3f01b82c38a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4901e2b7-d293-4700-9f5c-189bf0e8c23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4901e2b7-d293-4700-9f5c-189bf0e8c23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb979f42-f113-4ba6-b660-7532fd0e9933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume e38973e4-94fc-474d-9e04-f3f01b82c38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e38973e4-94fc-474d-9e04-f3f01b82c38a', 'volume_size': 1} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df09b9b-daff-45b8-9fc4-a9b22f31897e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:51 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:51 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:51 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d" returned: 0 in 0.863s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] <== create_volume: return (2346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.350s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.701s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-135127121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8791db81-29bc-448f-a378-04baa355ba9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:50Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating volume 8791db81-29bc-448f-a378-04baa355ba9a {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:51 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d72ae31-9747-4c1b-b4d2-e1ae7d99d109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0526302d-46b1-4399-99bb-4c6f4319416d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:51 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a 1073741824 Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055ffd21-4e5d-4214-a9f6-c1c2eed8c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:51 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume volume-0526302d-46b1-4399-99bb-4c6f4319416d (0526302d-46b1-4399-99bb-4c6f4319416d): created successfully Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (055ffd21-4e5d-4214-a9f6-c1c2eed8c1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (186b5cab-2d22-40e5-b126-7810535d2b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e286bd11-5b77-4fa4-b14b-39c856c92564 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created volume successfully. Jul 07 09:26:52 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.936s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:52 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:52 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:52 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a 1073741824" returned: 0 in 0.938s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:52 devstack sudo[103062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a Jul 07 09:26:52 devstack sudo[103062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:53 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 0.882s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:53 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc Jul 07 09:26:53 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:53 devstack sudo[103062]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.975s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-434576107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f1e593-a70f-4a18-b199-77b4fe86c63a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:50Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating volume 24f1e593-a70f-4a18-b199-77b4fe86c63a {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:53 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1e263d8-88ca-4b80-91af-0fdced499a76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8791db81-29bc-448f-a378-04baa355ba9a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:53 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a 1073741824 Jul 07 09:26:53 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536653bb-2394-440b-886a-6e681f251c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume volume-8791db81-29bc-448f-a378-04baa355ba9a (8791db81-29bc-448f-a378-04baa355ba9a): created successfully Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (536653bb-2394-440b-886a-6e681f251c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (ad6cc8c3-a595-4967-b50d-a6bb3a4eb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7c23e9b8-a874-4ca6-b71d-7ec1609b7a61 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created volume successfully. Jul 07 09:26:53 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.60508861-052d-4fee-a378-2c385b9914dc" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-60508861-052d-4fee-a378-2c385b9914dc" released by "_delete_snapshot" :: held 4.089s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" released by "delete_snapshot" :: held 4.180s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:54 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Created reservations ['0a82626e-1f58-4c38-8f76-1b7b3eba5c3c', '16eb8954-1f5b-4734-9a80-129b7982d3da', '1da4293a-7f22-4bed-b6eb-81c2dda71d5f', 'ddc17162-3d9e-4012-afea-5e2e9e38bfe6'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Delete snapshot completed successfully. Jul 07 09:26:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-87faf2c0-378f-4098-af48-c08e5e229291 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-60508861-052d-4fee-a378-2c385b9914dc-delete_snapshot" released by "delete_snapshot" :: held 4.348s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:54 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a 1073741824" returned: 0 in 0.916s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:54 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a Jul 07 09:26:54 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-bd2a0e83-20b8-45e4-8aa3-eb557994cce1-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-bd2a0e83-20b8-45e4-8aa3-eb557994cce1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-bd2a0e83-20b8-45e4-8aa3-eb557994cce1" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-bd2a0e83-20b8-45e4-8aa3-eb557994cce1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Deleting offline snapshot bd2a0e83-20b8-45e4-8aa3-eb557994cce1 of volume ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] snapshot_file for this snap is: volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5a84fc-b031-4e0d-9436-4437ed25cc69]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:55 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a" returned: 0 in 0.680s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.336s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1630542059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8ab0c63-58ba-4c03-abd7-c583336e708f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:51Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating volume b8ab0c63-58ba-4c03-abd7-c583336e708f {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:55 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b190269-3ce8-447d-9c6c-a50904c63a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f1e593-a70f-4a18-b199-77b4fe86c63a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9204aed-756a-4f4b-88e2-7ca6349035c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:55 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f 1073741824 Jul 07 09:26:55 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:55 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume volume-24f1e593-a70f-4a18-b199-77b4fe86c63a (24f1e593-a70f-4a18-b199-77b4fe86c63a): created successfully Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9204aed-756a-4f4b-88e2-7ca6349035c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (0e1c260f-532b-4cda-ab28-fe4173c1f9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e07a09f7-2c51-4548-9564-9878cc8b21df tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created volume successfully. Jul 07 09:26:55 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:55 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:55 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae3e2b3-8807-4694-9ad4-548fe6a0056c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:56 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e Jul 07 09:26:56 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:56 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f 1073741824" returned: 0 in 0.949s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:56 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f Jul 07 09:26:56 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:56 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" returned: 0 in 0.827s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:56 devstack sudo[103100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:56 devstack sudo[103100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:56 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f" returned: 0 in 0.685s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.692s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.582s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1334747475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e38973e4-94fc-474d-9e04-f3f01b82c38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b318880f5c5648e4a7ca5afd30f4aade',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:51Z,use_quota=True,user_id='802a7c3ad267464f8bd4cb45f9290d9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Creating volume e38973e4-94fc-474d-9e04-f3f01b82c38a {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:26:56 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f59aeee-0d74-4500-9155-c0c48988cc42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8ab0c63-58ba-4c03-abd7-c583336e708f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:56 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a 1073741824 Jul 07 09:26:56 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f49fc70-7731-4639-83f1-7316afd8e3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:56 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume volume-b8ab0c63-58ba-4c03-abd7-c583336e708f (b8ab0c63-58ba-4c03-abd7-c583336e708f): created successfully Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f49fc70-7731-4639-83f1-7316afd8e3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (ccb400be-dfb5-4e74-98fd-9242eae1ea39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ebe64545-0509-4987-9b91-fdb9dd46173f tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created volume successfully. Jul 07 09:26:57 devstack sudo[103100]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.844s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:26:57 devstack sudo[103112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1 Jul 07 09:26:57 devstack sudo[103112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Flow 'volume_create_manager' (4228a6a2-8c9c-4974-916d-b534c3881889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8a619c-e1fa-45b4-8244-9a6fa78bc765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8a619c-e1fa-45b4-8244-9a6fa78bc765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1706b37-8250-41eb-b608-c5f05e664575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79a699e7d204d03a5709c9b3cecd89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:58Z,use_quota=True,user_id='0859e23f998b4cb39cb2e302690dd962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97196363-5fd4-45b2-b4f0-af087fd94a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97196363-5fd4-45b2-b4f0-af087fd94a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63584b80-c78c-4717-933f-8f1631c9ae73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:26:57 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a 1073741824" returned: 0 in 0.987s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:57 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a Jul 07 09:26:57 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63584b80-c78c-4717-933f-8f1631c9ae73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f1706b37-8250-41eb-b608-c5f05e664575', 'volume_name': 'volume-f1706b37-8250-41eb-b608-c5f05e664575', 'volume_size': 1, 'image_id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9668fc8c324621096ff88d552dd02845', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e79a699e7d204d03a5709c9b3cecd89d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ad42a08a9b314a41b2184ae2fca9d204b3a18f9c762d775aa785146b6e4b770a5c84153328d69a32896cede6a73940613bc07123240d0d76cf6fef52e4f12d4', 'id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'created_at': datetime.datetime(2026, 7, 7, 7, 26, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3/file', 'properties': {}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5b6613-a4ef-40e6-a8a6-6d3c1c1f5176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a5b6613-a4ef-40e6-a8a6-6d3c1c1f5176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c54d7d9-ae84-4876-a183-e53ec3703f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Volume f1706b37-8250-41eb-b608-c5f05e664575: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f1706b37-8250-41eb-b608-c5f05e664575', 'volume_size': 1, 'image_id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9668fc8c324621096ff88d552dd02845', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e79a699e7d204d03a5709c9b3cecd89d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ad42a08a9b314a41b2184ae2fca9d204b3a18f9c762d775aa785146b6e4b770a5c84153328d69a32896cede6a73940613bc07123240d0d76cf6fef52e4f12d4', 'id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'created_at': datetime.datetime(2026, 7, 7, 7, 26, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3/file', 'properties': {}}, 'image_service': } Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Trying to clone f1706b37-8250-41eb-b608-c5f05e664575 from image 54f0cc4a-333c-41de-81b2-ec11b62e83e3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:26:58 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Image download 0.00 MB at 0.00 MB/s Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[483a003a-54a9-47d8-a2a1-37a20b5edc10]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:58 devstack sudo[103112]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e.bd2a0e83-20b8-45e4-8aa3-eb557994cce1" returned: 0 in 0.709s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:58 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD Jul 07 09:26:58 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-bd2a0e83-20b8-45e4-8aa3-eb557994cce1" released by "_delete_snapshot" :: held 3.317s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" released by "delete_snapshot" :: held 3.349s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Created reservations ['8744ab05-966f-47cd-98ab-cba274b41e3a', '8adb8ada-c096-450a-882c-8c056e565951', '39a6a230-3f66-4613-9b4f-cbd1cbe2c2e5', '01de01e5-e8ed-459a-8b2d-4a56ef1ecd20'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:26:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Delete snapshot completed successfully. Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-760938e7-7525-4750-890f-62d225bbf7fb tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-bd2a0e83-20b8-45e4-8aa3-eb557994cce1-delete_snapshot" released by "delete_snapshot" :: held 3.499s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:26:58 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a" returned: 0 in 0.722s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb979f42-f113-4ba6-b660-7532fd0e9933) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e38973e4-94fc-474d-9e04-f3f01b82c38a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34e4cf0-db70-4882-926b-fd17ff7ccf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:26:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Volume volume-e38973e4-94fc-474d-9e04-f3f01b82c38a (e38973e4-94fc-474d-9e04-f3f01b82c38a): created successfully Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d34e4cf0-db70-4882-926b-fd17ff7ccf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Flow 'volume_create_manager' (581af437-5387-44ab-bf76-88664348f52c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:26:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6be71464-8511-4742-90d3-d0b23246d4c9 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created volume successfully. Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-e38973e4-94fc-474d-9e04-f3f01b82c38a-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-e38973e4-94fc-474d-9e04-f3f01b82c38a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-e38973e4-94fc-474d-9e04-f3f01b82c38a" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-e38973e4-94fc-474d-9e04-f3f01b82c38a" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f7b55b-8215-4a63-93b7-9d450c555efa]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:59 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:59 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a Jul 07 09:26:59 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:59 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD Jul 07 09:26:59 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cc615f-c897-4931-ad83-d240a8901809]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:59 devstack sudo[103126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e Jul 07 09:26:59 devstack sudo[103126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:59 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a" returned: 0 in 0.787s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:26:59 devstack sudo[103134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a Jul 07 09:26:59 devstack sudo[103134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:26:59 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD" returned: 1 in 0.810s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Temporary image 54f0cc4a-333c-41de-81b2-ec11b62e83e3 is fetched for user 0859e23f998b4cb39cb2e302690dd962. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2fb2de-eb0f-47ef-9e9d-7f677e968bb0]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:26:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:00 devstack sudo[103136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD Jul 07 09:27:00 devstack sudo[103136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:00 devstack sudo[103126]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" returned: 0 in 0.806s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:00 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e Jul 07 09:27:00 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:00 devstack sudo[103134]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e38973e4-94fc-474d-9e04-f3f01b82c38a" returned: 0 in 0.700s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-e38973e4-94fc-474d-9e04-f3f01b82c38a" released by "delete_volume" :: held 1.538s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['923a4164-480e-4fd0-aac0-d9777be8f8d7', '83baba90-7bad-472f-8f9c-cf6d80dbfb44', '9cf746c0-5fef-4ae0-9c9f-82c9be2d6451', 'ec1f8e96-9bd4-4a46-b3c3-194efacef4e0'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:00 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:00 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:00 devstack sudo[103136]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD" returned: 0 in 0.800s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:00 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD Jul 07 09:27:00 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:00 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" returned: 0 in 0.713s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-quobyte-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e" released by "delete_volume" :: held 1.595s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Created reservations ['263eaecb-f886-4ea5-8363-10f047a5e531', '95b18d7e-e52d-4bcb-abe5-ac9507695ad5', '836f8daf-b459-40a2-bb67-9c0ea6746353', '0447c805-d56f-4501-a7fb-5cc39d0cc15c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-b8ab0c63-58ba-4c03-abd7-c583336e708f-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-b8ab0c63-58ba-4c03-abd7-c583336e708f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:01 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:01 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-b8ab0c63-58ba-4c03-abd7-c583336e708f" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:01 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-b8ab0c63-58ba-4c03-abd7-c583336e708f" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleted volume successfully. Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a79126-f601-4f20-a913-d0263490235f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4b01b59c-020b-47c2-856c-c9defbd5165d tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-e38973e4-94fc-474d-9e04-f3f01b82c38a-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:01 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f Jul 07 09:27:01 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:01 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD" returned: 1 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1706b37-8250-41eb-b608-c5f05e664575,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e79a699e7d204d03a5709c9b3cecd89d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:26:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:26:58Z,use_quota=True,user_id='0859e23f998b4cb39cb2e302690dd962',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Creating volume f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:01 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:01 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 1073741824 Jul 07 09:27:01 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:01 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.767s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:01 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Deleted volume successfully. Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c39495a-2cd8-4f0f-890a-8c30b28fa948 tempest-VolumesSnapshotListTestJSON-106317106 None] Lock "cinder-ab3b2c0f-81be-4e43-a7b8-ff1e5d7b847e-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:02 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f" returned: 0 in 0.838s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:02 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f Jul 07 09:27:02 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:02 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 1073741824" returned: 0 in 0.989s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:02 devstack sudo[103173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:02 devstack sudo[103173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:02 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b8ab0c63-58ba-4c03-abd7-c583336e708f" returned: 0 in 0.789s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-b8ab0c63-58ba-4c03-abd7-c583336e708f" released by "delete_volume" :: held 1.692s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['2b8fa248-5ca7-40c2-83a2-e4ed18df8b41', 'd97eb3ae-d2b2-4b05-8962-3d832c364b09', '845d4337-8645-478d-84df-b127c0a8359d', 'b050a675-2040-4034-a584-78f9057019f6'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:03 devstack sudo[103176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:03 devstack sudo[103176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:03 devstack sudo[103173]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 0 in 0.717s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Attempting download of 54f0cc4a-333c-41de-81b2-ec11b62e83e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'metadata': {}}])) to volume f1706b37-8250-41eb-b608-c5f05e664575. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2688c2c-e92c-4959-839f-cf2bbd75a324]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-24f1e593-a70f-4a18-b199-77b4fe86c63a-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-24f1e593-a70f-4a18-b199-77b4fe86c63a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-24f1e593-a70f-4a18-b199-77b4fe86c63a" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-24f1e593-a70f-4a18-b199-77b4fe86c63a" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64e76a4-2d68-4f14-8454-6228474144f1]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:03 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9 Jul 07 09:27:03 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:03 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a Jul 07 09:27:03 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:03 devstack sudo[103176]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.768s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleted volume successfully. Jul 07 09:27:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-58455260-f46a-46ea-b2c6-714916e28565 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-b8ab0c63-58ba-4c03-abd7-c583336e708f-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:04 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9" returned: 0 in 0.893s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:04 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a" returned: 0 in 0.859s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:04 devstack sudo[103189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9 Jul 07 09:27:04 devstack sudo[103189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:04 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a Jul 07 09:27:04 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Flow 'volume_create_manager' (c07bce1f-3a4b-41ad-916d-62e5d54b1bb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fb8286-1b17-4b97-ba2b-4526f4e1f930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83fb8286-1b17-4b97-ba2b-4526f4e1f930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1200108872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab552622-f4e4-4c29-b4dd-947e99a652ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7759f222c343b6b253bf056859dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:05Z,use_quota=True,user_id='41a080a772e848638ddefad673f6027d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9678ba-bbb0-46e7-92b6-cf6e05c509a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df9678ba-bbb0-46e7-92b6-cf6e05c509a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b54a26-269d-4c05-9e90-221072d0c339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b54a26-269d-4c05-9e90-221072d0c339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab552622-f4e4-4c29-b4dd-947e99a652ef', 'volume_name': 'volume-ab552622-f4e4-4c29-b4dd-947e99a652ef', 'volume_size': 2}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646a8f22-16a5-41c2-9c16-b79e3f93e17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:05 devstack sudo[103189]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (646a8f22-16a5-41c2-9c16-b79e3f93e17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44893e7e-5c5b-454a-9a6f-fcc7100e4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Volume ab552622-f4e4-4c29-b4dd-947e99a652ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab552622-f4e4-4c29-b4dd-947e99a652ef', 'volume_size': 2} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1200108872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab552622-f4e4-4c29-b4dd-947e99a652ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df7759f222c343b6b253bf056859dd72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:05Z,use_quota=True,user_id='41a080a772e848638ddefad673f6027d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Creating volume ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:05 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:05 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef 2147483648 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9" returned: 1 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_54f0cc4a-333c-41de-81b2-ec11b62e83e3_20_jrhy9' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-24f1e593-a70f-4a18-b199-77b4fe86c63a" returned: 0 in 0.712s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:05 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef 2147483648 Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[613db8ef-c5f6-40d8-a4a0-3df62eed9aae]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:05 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-24f1e593-a70f-4a18-b199-77b4fe86c63a" released by "delete_volume" :: held 1.634s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['cd3f8f6d-1433-4448-9ea4-df1779858d8f', '9ec99068-8795-4e0e-9271-67be858f6443', '64968a6a-dad7-45f3-ab99-4defd8eb26ce', 'd9f5bd46-c2e4-495e-82c8-6548dfa43cf9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:05 devstack sudo[103199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD Jul 07 09:27:05 devstack sudo[103199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:05 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:05 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-8791db81-29bc-448f-a378-04baa355ba9a-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-8791db81-29bc-448f-a378-04baa355ba9a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-8791db81-29bc-448f-a378-04baa355ba9a" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-8791db81-29bc-448f-a378-04baa355ba9a" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[05030698-de6f-4cba-852f-fdd46be47502]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:05 devstack sudo[103211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a Jul 07 09:27:05 devstack sudo[103211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:05 devstack sudo[103199]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:06 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.721s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleted volume successfully. Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-86449149-53fe-4b07-8572-aaa5cd2503fb tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-24f1e593-a70f-4a18-b199-77b4fe86c63a-delete_volume" released by "delete_volume" :: held 2.571s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:06 devstack sudo[103214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD Jul 07 09:27:06 devstack sudo[103214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:06 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef 2147483648" returned: 0 in 1.031s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:06 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef Jul 07 09:27:06 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:06 devstack sudo[103211]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:06 devstack sudo[103224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a Jul 07 09:27:06 devstack sudo[103224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:06 devstack sudo[103214]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD" returned: 1 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] 54f0cc4a-333c-41de-81b2-ec11b62e83e3 was raw, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:06 devstack sudo[103227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:06 devstack sudo[103227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:06 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44893e7e-5c5b-454a-9a6f-fcc7100e4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab552622-f4e4-4c29-b4dd-947e99a652ef', 'volume_size': 2}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945406b5-6a07-408f-840f-d0ec0a98386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Volume volume-ab552622-f4e4-4c29-b4dd-947e99a652ef (ab552622-f4e4-4c29-b4dd-947e99a652ef): created successfully Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945406b5-6a07-408f-840f-d0ec0a98386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Flow 'volume_create_manager' (c07bce1f-3a4b-41ad-916d-62e5d54b1bb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2540f966-f248-4ca8-b1e5-74704e13f8d7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Created volume successfully. Jul 07 09:27:07 devstack sudo[103224]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8791db81-29bc-448f-a378-04baa355ba9a" returned: 0 in 0.710s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-8791db81-29bc-448f-a378-04baa355ba9a" released by "delete_volume" :: held 1.562s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Creating offline snapshot e486ab88-30dd-4583-9247-02776115a6f1 of volume ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb71bd01-85c9-4480-a4b1-6fe6e3eb1b08]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['4ec9e354-69ce-4cbd-b467-da750e2a9d9c', '75667a08-d6d5-4636-9598-1f3f33559bf2', 'd0189dc5-b6ee-4260-b517-aeb8c178a6cb', '2c7c8e4e-ba53-4545-bd24-b5fbf40a3433'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:07 devstack sudo[103233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef Jul 07 09:27:07 devstack sudo[103233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:07 devstack sudo[103227]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_54f0cc4a-333c-41de-81b2-ec11b62e83e3_rdu_to6adevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:27:07 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 09:27:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:07 devstack sudo[103235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:07 devstack sudo[103235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:07 devstack sudo[103236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 1G Jul 07 09:27:07 devstack sudo[103236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-0526302d-46b1-4399-99bb-4c6f4319416d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-0526302d-46b1-4399-99bb-4c6f4319416d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-0526302d-46b1-4399-99bb-4c6f4319416d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-0526302d-46b1-4399-99bb-4c6f4319416d" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cd85a7-9aa0-4d9c-81f5-7611ef5e0aa3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:08 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d Jul 07 09:27:08 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:08 devstack sudo[103233]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef" returned: 0 in 0.880s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 2G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:08 devstack sudo[103235]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.766s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:08 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleted volume successfully. Jul 07 09:27:08 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 2G Jul 07 09:27:08 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b7165a49-ff6e-46af-b73c-ac7a36cb72de tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-8791db81-29bc-448f-a378-04baa355ba9a-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:08 devstack sudo[103236]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 1G" returned: 0 in 0.816s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b1b087-6453-48a4-aba0-b28c739fb19f]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:08 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:08 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:09 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d" returned: 0 in 0.892s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:09 devstack sudo[103260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d Jul 07 09:27:09 devstack sudo[103260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:09 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 2G" returned: 0 in 0.846s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab552622-f4e4-4c29-b4dd-947e99a652ef -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:09 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab552622-f4e4-4c29-b4dd-947e99a652ef -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 Jul 07 09:27:09 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:09 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 0 in 0.820s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:09 devstack sudo[103266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:09 devstack sudo[103266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:09 devstack sudo[103260]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0526302d-46b1-4399-99bb-4c6f4319416d" returned: 0 in 0.668s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-0526302d-46b1-4399-99bb-4c6f4319416d" released by "delete_volume" :: held 1.605s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['18cafc2b-b691-496f-bf38-116b797a958c', '6daa4c1c-699f-4169-a385-76449a0a4cab', '2c21d77e-ecb8-46a6-a604-1a2e31cc5937', 'a0a0ff94-d449-4f8a-a227-822ea47e09e3'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:09 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:09 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:09 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab552622-f4e4-4c29-b4dd-947e99a652ef -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1" returned: 0 in 0.739s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:09 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 is being set with open permissions: ugo+rw Jul 07 09:27:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:09 devstack sudo[103276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 Jul 07 09:27:09 devstack sudo[103276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:10 devstack sudo[103266]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 1 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Downloaded image 54f0cc4a-333c-41de-81b2-ec11b62e83e3 ((None, [{'url': 'file:///opt/stack/data/glance/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'metadata': {}}])) to volume f1706b37-8250-41eb-b608-c5f05e664575 successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Temporary image 54f0cc4a-333c-41de-81b2-ec11b62e83e3 for user 0859e23f998b4cb39cb2e302690dd962 is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Marking volume f1706b37-8250-41eb-b608-c5f05e664575 as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Copying metadata from image 54f0cc4a-333c-41de-81b2-ec11b62e83e3 to f1706b37-8250-41eb-b608-c5f05e664575. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Creating volume glance metadata for volume f1706b37-8250-41eb-b608-c5f05e664575 backed by image 54f0cc4a-333c-41de-81b2-ec11b62e83e3 with: {'image_id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9668fc8c324621096ff88d552dd02845', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c54d7d9-ae84-4876-a183-e53ec3703f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1706b37-8250-41eb-b608-c5f05e664575', 'volume_size': 1, 'image_id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9668fc8c324621096ff88d552dd02845', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e79a699e7d204d03a5709c9b3cecd89d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5ad42a08a9b314a41b2184ae2fca9d204b3a18f9c762d775aa785146b6e4b770a5c84153328d69a32896cede6a73940613bc07123240d0d76cf6fef52e4f12d4', 'id': '54f0cc4a-333c-41de-81b2-ec11b62e83e3', 'created_at': datetime.datetime(2026, 7, 7, 7, 26, 55, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 26, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/54f0cc4a-333c-41de-81b2-ec11b62e83e3/file', 'properties': {}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2b2cb8-2138-4af2-b18f-b1dd393bf838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:10 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Volume volume-f1706b37-8250-41eb-b608-c5f05e664575 (f1706b37-8250-41eb-b608-c5f05e664575): created successfully Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc2b2cb8-2138-4af2-b18f-b1dd393bf838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Flow 'volume_create_manager' (4228a6a2-8c9c-4974-916d-b534c3881889) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-48ec4c33-869d-4309-8e86-7d1363384a1b tempest-VolumeImageDependencyTests-572192511 None] Created volume successfully. Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-8fd0310a-e0eb-4681-8b83-f17d4815c0b4-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-8fd0310a-e0eb-4681-8b83-f17d4815c0b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-90394c2e-e14e-43ff-9307-e755c3ecdd57" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-90394c2e-e14e-43ff-9307-e755c3ecdd57" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-8fd0310a-e0eb-4681-8b83-f17d4815c0b4" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-8fd0310a-e0eb-4681-8b83-f17d4815c0b4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleting offline snapshot 8fd0310a-e0eb-4681-8b83-f17d4815c0b4 of volume 90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] snapshot_file for this snap is: volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a48c58-1c1b-4537-87c3-5312f6d99ee9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:10 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 Jul 07 09:27:10 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Acquiring lock "cinder-f1706b37-8250-41eb-b608-c5f05e664575-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Lock "cinder-f1706b37-8250-41eb-b608-c5f05e664575-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:10 devstack sudo[103276]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:10 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1" returned: 0 in 0.743s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleted volume successfully. Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Acquiring lock "cinder-quobyte-f1706b37-8250-41eb-b608-c5f05e664575" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Lock "cinder-quobyte-f1706b37-8250-41eb-b608-c5f05e664575" acquired by "delete_volume" :: waited 0.034s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d41f3dd8-bfa8-4bca-bdd6-9d76fd40ab60 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-0526302d-46b1-4399-99bb-4c6f4319416d-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3512282f-b210-4c5f-bffe-c62e48547eca]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:10 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info Jul 07 09:27:10 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:10 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:10 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:11 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4" returned: 0 in 0.877s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-90394c2e-e14e-43ff-9307-e755c3ecdd57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[15af33de-61e2-4201-aefe-bdd5d9ff6da4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:11 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info" returned: 0 in 0.679s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:11 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info is being set with open permissions: ugo+rw Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:11 devstack sudo[103293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info Jul 07 09:27:11 devstack sudo[103293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:11 devstack sudo[103291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 Jul 07 09:27:11 devstack sudo[103291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:11 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 0 in 0.807s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:11 devstack sudo[103298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:11 devstack sudo[103298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:12 devstack sudo[103293]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.info" returned: 0 in 0.667s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.701s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:12 devstack sudo[103291]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57" returned: 0 in 0.803s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-33fa7c0c-e4c0-4e00-9d38-1dcd217e1b8c tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Create snapshot completed successfully Jul 07 09:27:12 devstack sudo[103304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 Jul 07 09:27:12 devstack sudo[103304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:12 devstack sudo[103298]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 1 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:12 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575 Jul 07 09:27:12 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "cinder-e486ab88-30dd-4583-9247-02776115a6f1-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-e486ab88-30dd-4583-9247-02776115a6f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "cinder-quobyte-ab552622-f4e4-4c29-b4dd-947e99a652ef" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-quobyte-ab552622-f4e4-4c29-b4dd-947e99a652ef" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "cinder-quobyte-e486ab88-30dd-4583-9247-02776115a6f1" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-quobyte-e486ab88-30dd-4583-9247-02776115a6f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Deleting offline snapshot e486ab88-30dd-4583-9247-02776115a6f1 of volume ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] snapshot_file for this snap is: volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[490c390f-01c9-4241-8282-d76d3facf048]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:12 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 Jul 07 09:27:12 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:12 devstack sudo[103304]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:12 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4 Jul 07 09:27:12 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:13 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f1706b37-8250-41eb-b608-c5f05e664575" returned: 0 in 0.683s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Lock "cinder-quobyte-f1706b37-8250-41eb-b608-c5f05e664575" released by "delete_volume" :: held 2.334s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:INSERT=38,cinder:UPDATE=148,cinder:SELECT=125,cinder:DELETE=16 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=127,cinder:INSERT=49,cinder:UPDATE=170,cinder:DELETE=13 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Created reservations ['679861af-d877-4eeb-8d75-34adbf819ad4', '304d9f66-a60a-44d2-bcf1-2ae0ff1c8a04', 'dd570dbf-bce4-4977-a2f9-5b7b99ffaa1e', '499e7cfa-e5c1-4cdd-8167-c2e9b5fd47a9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:13 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:13 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:13 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57.8fd0310a-e0eb-4681-8b83-f17d4815c0b4" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:13 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1" returned: 0 in 0.839s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab552622-f4e4-4c29-b4dd-947e99a652ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[79970be7-5d0f-4371-8cd7-42657945031d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-8fd0310a-e0eb-4681-8b83-f17d4815c0b4" released by "_delete_snapshot" :: held 3.338s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-90394c2e-e14e-43ff-9307-e755c3ecdd57" released by "delete_snapshot" :: held 3.369s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['3fcdfd19-cf8d-4b39-a391-5acb7ff0dc6a', '267fe9d2-791f-4776-a387-fa7e7071f549', 'ed0c32c2-1371-46fc-82ee-95aa908df7c5', 'b0546830-60ae-45bb-939e-bc2dc9b8e560'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:13 devstack sudo[103326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef Jul 07 09:27:13 devstack sudo[103326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Delete snapshot completed successfully. Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-76747b04-f012-4483-b7ec-659603b99fc1 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-8fd0310a-e0eb-4681-8b83-f17d4815c0b4-delete_snapshot" released by "delete_snapshot" :: held 3.540s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:13 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Deleted volume successfully. Jul 07 09:27:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e3a178d5-9ab2-4ce2-a6ce-aed946010bcc tempest-VolumeImageDependencyTests-572192511 None] Lock "cinder-f1706b37-8250-41eb-b608-c5f05e664575-delete_volume" released by "delete_volume" :: held 3.309s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:14 devstack sudo[103326]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef" returned: 0 in 0.809s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:14 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 Jul 07 09:27:14 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-90394c2e-e14e-43ff-9307-e755c3ecdd57-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-90394c2e-e14e-43ff-9307-e755c3ecdd57-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "cinder-quobyte-90394c2e-e14e-43ff-9307-e755c3ecdd57" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-90394c2e-e14e-43ff-9307-e755c3ecdd57" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1814818c-5c48-4493-8ad0-fc33ffe1731c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:14 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 Jul 07 09:27:14 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:15 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1" returned: 0 in 0.858s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:15 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1 Jul 07 09:27:15 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:15 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57" returned: 0 in 0.822s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:15 devstack sudo[103344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57 Jul 07 09:27:15 devstack sudo[103344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:16 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef.e486ab88-30dd-4583-9247-02776115a6f1" returned: 0 in 0.702s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-quobyte-e486ab88-30dd-4583-9247-02776115a6f1" released by "_delete_snapshot" :: held 3.337s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-quobyte-ab552622-f4e4-4c29-b4dd-947e99a652ef" released by "delete_snapshot" :: held 3.364s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Created reservations ['726aceb5-4c64-493e-a80d-9a912ab5cd08', '9fee0bd1-3caf-4dcc-98d8-d53e6383dd6b', '8f0b788e-8c0c-4638-82fa-6ef94ef26931', 'a4405744-af83-499d-9185-e8bad3358da3'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:16 devstack sudo[103344]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-90394c2e-e14e-43ff-9307-e755c3ecdd57" returned: 0 in 0.696s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-quobyte-90394c2e-e14e-43ff-9307-e755c3ecdd57" released by "delete_volume" :: held 1.596s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Delete snapshot completed successfully. Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-bfca1793-6f5b-4eae-819e-74ef3461070d tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-e486ab88-30dd-4583-9247-02776115a6f1-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Created reservations ['64a4d768-767d-4504-94ee-6fda09a1ba00', '5c6b5966-8450-4241-b540-0e3a1d475429', 'eab98093-c5dc-48ed-8b49-6acc3a3d1bce', '7e361ceb-1471-4873-96f8-1f7ce28a737f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:16 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:16 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "cinder-ab552622-f4e4-4c29-b4dd-947e99a652ef-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:17 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Deleted volume successfully. Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-ab552622-f4e4-4c29-b4dd-947e99a652ef-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4312bd82-0c7c-49c3-bd3b-663d8785b039 tempest-CreateVolumesFromSnapshotTest-1795782490 None] Lock "cinder-90394c2e-e14e-43ff-9307-e755c3ecdd57-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "cinder-quobyte-ab552622-f4e4-4c29-b4dd-947e99a652ef" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-quobyte-ab552622-f4e4-4c29-b4dd-947e99a652ef" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[733bf544-bf17-47a0-9e09-9d4153d13d34]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Flow 'volume_create_manager' (5df0675e-f3d0-4352-bc5c-c584bf82a84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeff318b-9926-4584-9ec4-18d55b734869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeff318b-9926-4584-9ec4-18d55b734869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f936fc3-7873-4557-8fcf-e07161870e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea74174f484d0d866ec31cab95644b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:17Z,use_quota=True,user_id='575909c0e62f4ff597dfabb011969b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af8fa92-190b-4e2e-b2f1-946e28cf66ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af8fa92-190b-4e2e-b2f1-946e28cf66ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e02fd3-4aba-49a6-921c-f6bf78c001cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:17 devstack sudo[103351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef Jul 07 09:27:17 devstack sudo[103351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2e02fd3-4aba-49a6-921c-f6bf78c001cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f936fc3-7873-4557-8fcf-e07161870e75', 'volume_name': 'volume-8f936fc3-7873-4557-8fcf-e07161870e75', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a4d6f-be27-4b3c-821c-aeb43858c13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695a4d6f-be27-4b3c-821c-aeb43858c13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddba24c2-b18f-40e5-a4bf-5e8c0b72e616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:17 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Volume 8f936fc3-7873-4557-8fcf-e07161870e75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f936fc3-7873-4557-8fcf-e07161870e75', 'volume_size': 1} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f936fc3-7873-4557-8fcf-e07161870e75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea74174f484d0d866ec31cab95644b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:17Z,use_quota=True,user_id='575909c0e62f4ff597dfabb011969b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Creating volume 8f936fc3-7873-4557-8fcf-e07161870e75 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:17 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:17 devstack sudo[103353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 1073741824 Jul 07 09:27:17 devstack sudo[103353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:18 devstack sudo[103351]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef" returned: 0 in 0.817s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:18 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef Jul 07 09:27:18 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:18 devstack sudo[103353]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 1073741824" returned: 0 in 0.984s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:18 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 Jul 07 09:27:18 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:18 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ab552622-f4e4-4c29-b4dd-947e99a652ef" returned: 0 in 0.714s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-quobyte-ab552622-f4e4-4c29-b4dd-947e99a652ef" released by "delete_volume" :: held 1.612s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Created reservations ['7b3cbc4d-c0aa-4176-8344-f5f79bf849e0', 'a064e186-23cc-451a-ab9b-70bbc06d54d0', '97bee97e-a7ec-4e77-b9f4-a3d012d68365', '159d2bc1-2f23-48d2-b235-5735056e5f17'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:18 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:18 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:19 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75" returned: 0 in 0.711s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddba24c2-b18f-40e5-a4bf-5e8c0b72e616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f936fc3-7873-4557-8fcf-e07161870e75', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a76bf8a-ec6e-4723-84bd-8c8797685725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Volume volume-8f936fc3-7873-4557-8fcf-e07161870e75 (8f936fc3-7873-4557-8fcf-e07161870e75): created successfully Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a76bf8a-ec6e-4723-84bd-8c8797685725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Flow 'volume_create_manager' (5df0675e-f3d0-4352-bc5c-c584bf82a84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:19 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d06765ba-fe9e-4d9a-b715-ac3dd5e74301 tempest-CinderUnicodeTest-832358253 None] Created volume successfully. Jul 07 09:27:19 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:19 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Deleted volume successfully. Jul 07 09:27:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f402ec50-ff3a-4619-8020-da496dc59bd7 tempest-VolumesSnapshotNegativeTestJSON-173918371 None] Lock "cinder-ab552622-f4e4-4c29-b4dd-947e99a652ef-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Flow 'volume_create_manager' (c6c43529-9b7c-4ffc-8c8d-da901d4917ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aec4ca-42ee-421d-bee4-f9ce0739cd6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84aec4ca-42ee-421d-bee4-f9ce0739cd6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-693767282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269c08e-bc7f-46c1-a32d-5abe858c5c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea74174f484d0d866ec31cab95644b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:20Z,use_quota=True,user_id='575909c0e62f4ff597dfabb011969b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d44c9a-38c9-40b6-a278-b3583d4f3abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d44c9a-38c9-40b6-a278-b3583d4f3abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9741fb1-af3a-4f5d-9061-cb5464e46e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9741fb1-af3a-4f5d-9061-cb5464e46e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b269c08e-bc7f-46c1-a32d-5abe858c5c53', 'volume_name': 'volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14864156-cded-40e4-8b86-c35a7d07d6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14864156-cded-40e4-8b86-c35a7d07d6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e02403-640c-470d-8d51-2d142e77d52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Volume b269c08e-bc7f-46c1-a32d-5abe858c5c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53', 'volume_size': 1} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-693767282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269c08e-bc7f-46c1-a32d-5abe858c5c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1ea74174f484d0d866ec31cab95644b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:20Z,use_quota=True,user_id='575909c0e62f4ff597dfabb011969b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Creating volume b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:20 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:20 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 1073741824 Jul 07 09:27:20 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Flow 'volume_create_manager' (cb0faabd-21f0-4de5-bf4b-c262bf1e8ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b3a600-26a5-4cae-b1ea-a181228bd0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04b3a600-26a5-4cae-b1ea-a181228bd0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1166574611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28520da1-3e67-402b-be48-4de3c7843ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb7beb39d45492eb01575bcbf309c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:20Z,use_quota=True,user_id='72713f0196004ce98a23d7b95cea6ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bca19f8-d008-4c05-af68-f68890de0b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bca19f8-d008-4c05-af68-f68890de0b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c114625f-314c-4757-88f6-ad24f1c439cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c114625f-314c-4757-88f6-ad24f1c439cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28520da1-3e67-402b-be48-4de3c7843ed0', 'volume_name': 'volume-28520da1-3e67-402b-be48-4de3c7843ed0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d18b7b-490b-4e05-9f2e-75a8e2f75282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d18b7b-490b-4e05-9f2e-75a8e2f75282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cca46d-d8b7-45e0-8baf-319164f8acba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Volume 28520da1-3e67-402b-be48-4de3c7843ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28520da1-3e67-402b-be48-4de3c7843ed0', 'volume_size': 1} Jul 07 09:27:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:21 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 1073741824" returned: 0 in 0.922s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:21 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 Jul 07 09:27:21 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:21 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53" returned: 0 in 0.652s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.482s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1166574611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28520da1-3e67-402b-be48-4de3c7843ed0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb7beb39d45492eb01575bcbf309c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:20Z,use_quota=True,user_id='72713f0196004ce98a23d7b95cea6ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Creating volume 28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:21 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29e02403-640c-470d-8d51-2d142e77d52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:21 devstack sudo[103380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 1073741824 Jul 07 09:27:21 devstack sudo[103380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281aa530-ed31-4d8c-9723-730cd59de066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:21 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Volume volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 (b269c08e-bc7f-46c1-a32d-5abe858c5c53): created successfully Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281aa530-ed31-4d8c-9723-730cd59de066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Flow 'volume_create_manager' (c6c43529-9b7c-4ffc-8c8d-da901d4917ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ea413132-ede5-4f09-8549-53540e148e5a tempest-CinderUnicodeTest-832358253 None] Created volume successfully. Jul 07 09:27:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:22 devstack sudo[103380]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 1073741824" returned: 0 in 0.956s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:22 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:22 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:23 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] <== create_volume: return (1694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.170s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Creating offline snapshot d05f49c9-3d55-417b-93c5-67b4d28f94e2 of volume b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1cca46d-d8b7-45e0-8baf-319164f8acba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28520da1-3e67-402b-be48-4de3c7843ed0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dc1471-2379-432e-acf6-c97c8581f496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af47c88-5ebc-4bea-bb2f-ca7ba9568882]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:23 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Volume volume-28520da1-3e67-402b-be48-4de3c7843ed0 (28520da1-3e67-402b-be48-4de3c7843ed0): created successfully Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dc1471-2379-432e-acf6-c97c8581f496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Flow 'volume_create_manager' (cb0faabd-21f0-4de5-bf4b-c262bf1e8ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-795011c3-b7e6-47b0-b436-0d22468e5cd8 tempest-VolumeDependencyTests-1609204448 None] Created volume successfully. Jul 07 09:27:23 devstack sudo[103389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 Jul 07 09:27:23 devstack sudo[103389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:24 devstack sudo[103389]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53" returned: 0 in 0.845s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:24 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 1G Jul 07 09:27:24 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:25 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 1G" returned: 0 in 0.855s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:25 devstack sudo[103400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 Jul 07 09:27:25 devstack sudo[103400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:25 devstack sudo[103400]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2" returned: 0 in 0.717s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:25 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 is being set with open permissions: ugo+rw Jul 07 09:27:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:25 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 Jul 07 09:27:25 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:26 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2" returned: 0 in 0.759s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:26 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info Jul 07 09:27:26 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:27 devstack sudo[103411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:27 devstack sudo[103411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:27 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info" returned: 0 in 0.757s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:27 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info is being set with open permissions: ugo+rw Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:27 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info Jul 07 09:27:27 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:27 devstack sudo[103411]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.816s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:27:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:27:28 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.info" returned: 0 in 0.740s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.795s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.829s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Creating offline snapshot f85f38e4-e4f9-4460-9cef-1d22a9c153ab of volume 28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:27:28 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-66d823aa-3b19-4192-9c2c-54c77c2d1d15 tempest-CinderUnicodeTest-832358253 None] Create snapshot completed successfully Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4095fba9-3404-4e9a-a025-f5ddc33affbc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:28 devstack sudo[103418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:28 devstack sudo[103418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-d05f49c9-3d55-417b-93c5-67b4d28f94e2-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Lock "cinder-d05f49c9-3d55-417b-93c5-67b4d28f94e2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-quobyte-b269c08e-bc7f-46c1-a32d-5abe858c5c53" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-b269c08e-bc7f-46c1-a32d-5abe858c5c53" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-quobyte-d05f49c9-3d55-417b-93c5-67b4d28f94e2" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-d05f49c9-3d55-417b-93c5-67b4d28f94e2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Deleting offline snapshot d05f49c9-3d55-417b-93c5-67b4d28f94e2 of volume b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] snapshot_file for this snap is: volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc72eb7-dfeb-4fb6-bda3-53a6490cb743]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:28 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 Jul 07 09:27:28 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:29 devstack sudo[103418]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 0.924s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:29 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab 1G Jul 07 09:27:29 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:29 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2" returned: 0 in 0.868s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:27:29 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d651dc-a124-483c-808a-2a1503994e50]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:29 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 Jul 07 09:27:29 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:30 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab 1G" returned: 0 in 0.951s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28520da1-3e67-402b-be48-4de3c7843ed0 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:30 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28520da1-3e67-402b-be48-4de3c7843ed0 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab Jul 07 09:27:30 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:30 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53" returned: 0 in 0.914s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:30 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 Jul 07 09:27:30 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:31 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-28520da1-3e67-402b-be48-4de3c7843ed0 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab" returned: 0 in 0.807s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:31 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab is being set with open permissions: ugo+rw Jul 07 09:27:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:31 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab Jul 07 09:27:31 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:31 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:31 devstack sudo[103454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2 Jul 07 09:27:31 devstack sudo[103454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:31 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab" returned: 0 in 0.744s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:31 devstack sudo[103458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info Jul 07 09:27:31 devstack sudo[103458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:32 devstack sudo[103454]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53.d05f49c9-3d55-417b-93c5-67b4d28f94e2" returned: 0 in 0.709s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-d05f49c9-3d55-417b-93c5-67b4d28f94e2" released by "_delete_snapshot" :: held 3.452s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-b269c08e-bc7f-46c1-a32d-5abe858c5c53" released by "delete_snapshot" :: held 3.483s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Created reservations ['1d98a563-9a24-474b-a3c2-0403b32a5e0d', '5e451ec3-6865-4e38-b5d2-d611cb740e59', '9610017f-7cce-4e31-8184-208a34dde956', '396aa015-aea1-4b1e-af8d-4e639159d675'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Delete snapshot completed successfully. Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e5817f57-69d2-4eb9-9293-fee91445a8df tempest-CinderUnicodeTest-832358253 None] Lock "cinder-d05f49c9-3d55-417b-93c5-67b4d28f94e2-delete_snapshot" released by "delete_snapshot" :: held 3.654s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:32 devstack sudo[103458]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info" returned: 0 in 0.721s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:32 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info is being set with open permissions: ugo+rw Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:32 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info Jul 07 09:27:32 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-b269c08e-bc7f-46c1-a32d-5abe858c5c53-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Lock "cinder-b269c08e-bc7f-46c1-a32d-5abe858c5c53-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-quobyte-b269c08e-bc7f-46c1-a32d-5abe858c5c53" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-b269c08e-bc7f-46c1-a32d-5abe858c5c53" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fdd4aad-bcc1-44cf-aa87-c9879e4fe725]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:33 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 Jul 07 09:27:33 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:33 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.info" returned: 0 in 0.714s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.996s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-16c2527a-b3fa-4347-a6c8-d1ee96377cf3 tempest-VolumeDependencyTests-1609204448 None] Create snapshot completed successfully Jul 07 09:27:33 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53" returned: 0 in 0.768s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:33 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53 Jul 07 09:27:33 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Flow 'volume_create_manager' (a53e5c34-a6ab-4fca-b9db-a6ec447f65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1135d23e-2a24-4b2e-b813-9cbe04b0c697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1135d23e-2a24-4b2e-b813-9cbe04b0c697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2005275107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de32c325-1432-48ec-bf62-4da198507df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb7beb39d45492eb01575bcbf309c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f85f38e4-e4f9-4460-9cef-1d22a9c153ab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:34Z,use_quota=True,user_id='72713f0196004ce98a23d7b95cea6ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398486ba-e992-402c-ab9d-3b886cbef0a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398486ba-e992-402c-ab9d-3b886cbef0a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbec7ac-7286-4de2-9b8a-9ee8107d6e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dbec7ac-7286-4de2-9b8a-9ee8107d6e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de32c325-1432-48ec-bf62-4da198507df3', 'volume_name': 'volume-de32c325-1432-48ec-bf62-4da198507df3', 'volume_size': 1, 'snapshot_id': 'f85f38e4-e4f9-4460-9cef-1d22a9c153ab'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3e6f03-73c0-44d4-b693-f787745f70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c3e6f03-73c0-44d4-b693-f787745f70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dff327-2fe9-4d87-911b-e06d6a692e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:34 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Volume de32c325-1432-48ec-bf62-4da198507df3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de32c325-1432-48ec-bf62-4da198507df3', 'volume_size': 1, 'snapshot_id': 'f85f38e4-e4f9-4460-9cef-1d22a9c153ab'} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-quobyte-f85f38e4-e4f9-4460-9cef-1d22a9c153ab-de32c325-1432-48ec-bf62-4da198507df3" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:34 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b269c08e-bc7f-46c1-a32d-5abe858c5c53" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-f85f38e4-e4f9-4460-9cef-1d22a9c153ab-de32c325-1432-48ec-bf62-4da198507df3" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Creating volume de32c325-1432-48ec-bf62-4da198507df3 from snapshot f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-quobyte-de32c325-1432-48ec-bf62-4da198507df3" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-b269c08e-bc7f-46c1-a32d-5abe858c5c53" released by "delete_volume" :: held 1.646s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-de32c325-1432-48ec-bf62-4da198507df3" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] snapshot: f85f38e4-e4f9-4460-9cef-1d22a9c153ab, volume: de32c325-1432-48ec-bf62-4da198507df3, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac97cfd-7199-4968-bac5-71474882dfad]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Created reservations ['2ca7b7f5-c9bc-43a4-af37-f2dcecd648b8', '2689a317-4cd2-4438-869e-55c86e2a4036', 'f1835fdf-e697-4cdb-b423-88073938d6de', 'cce59e7f-8bc7-4e35-9d13-dd36bf7897e9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:34 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab Jul 07 09:27:34 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:34 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:34 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-8f936fc3-7873-4557-8fcf-e07161870e75-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Lock "cinder-8f936fc3-7873-4557-8fcf-e07161870e75-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Acquiring lock "cinder-quobyte-8f936fc3-7873-4557-8fcf-e07161870e75" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-8f936fc3-7873-4557-8fcf-e07161870e75" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[53924565-c5a8-434f-986e-bacc6dd5c7a3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:35 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 Jul 07 09:27:35 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:35 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.922s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Deleted volume successfully. Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b93b57ee-1f41-42cc-a69e-a62a219fa4fd tempest-CinderUnicodeTest-832358253 None] Lock "cinder-b269c08e-bc7f-46c1-a32d-5abe858c5c53-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:35 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab" returned: 0 in 1.096s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28520da1-3e67-402b-be48-4de3c7843ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a35163-45a8-4114-915d-bb0a20394c76]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:35 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:35 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:36 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75" returned: 0 in 1.060s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:36 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75 Jul 07 09:27:36 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:36 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 0.924s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:36 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:27:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:36 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 Jul 07 09:27:36 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:37 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8f936fc3-7873-4557-8fcf-e07161870e75" returned: 0 in 0.731s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Lock "cinder-quobyte-8f936fc3-7873-4557-8fcf-e07161870e75" released by "delete_volume" :: held 1.842s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Created reservations ['ae139ba8-3ff8-482f-b83a-32e4a0c5d68c', '45a10bfd-e3fd-4287-bf04-365b6f82c732', '58e91e16-28fc-44b2-8af3-735c4d64325c', '8c4b88c3-f158-4cc6-b1e5-1ce9ad11b7a9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:37 devstack sudo[103497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:37 devstack sudo[103497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:39 devstack sudo[103497]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.794s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:39 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Deleted volume successfully. Jul 07 09:27:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7be8e706-f31a-45a0-bc38-efca5a08dda2 tempest-CinderUnicodeTest-832358253 None] Lock "cinder-8f936fc3-7873-4557-8fcf-e07161870e75-delete_volume" released by "delete_volume" :: held 4.002s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:43 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3" returned: 0 in 6.534s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9e3d32-96be-4ad2-bf28-20a13fddf601]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:43 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:43 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:44 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 1.071s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:44 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0, size 1024.00 MB, duration 6.54 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:27:44 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Converted 1024.00 MB image at 156.63 MB/s Jul 07 09:27:44 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 is being set with open permissions: ugo+rw Jul 07 09:27:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:44 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 Jul 07 09:27:44 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:44 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Flow 'volume_create_manager' (80edfe98-0c0a-46d6-b06c-85f721d3e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fa2e5c-f636-4316-a4fa-a1c6671eb153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9fa2e5c-f636-4316-a4fa-a1c6671eb153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546200950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff750255-031f-4362-b653-39398ec6320d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2e328ee445d998926388034a04ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:45Z,use_quota=True,user_id='dd9565ba751245c09a8fcf989533ce20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feab84df-7c61-4000-98d2-287db53c19c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feab84df-7c61-4000-98d2-287db53c19c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87df85e7-2336-4888-9151-9fd1a2a3a74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87df85e7-2336-4888-9151-9fd1a2a3a74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff750255-031f-4362-b653-39398ec6320d', 'volume_name': 'volume-ff750255-031f-4362-b653-39398ec6320d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec94ef0-32b0-4518-8662-d3e936928eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ec94ef0-32b0-4518-8662-d3e936928eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58bda72-b963-4e06-944a-1969224b9913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:45 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Volume ff750255-031f-4362-b653-39398ec6320d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff750255-031f-4362-b653-39398ec6320d', 'volume_size': 1} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:45 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3" returned: 0 in 0.712s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-de32c325-1432-48ec-bf62-4da198507df3" released by "_copy_volume_from_snapshot" :: held 10.458s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-f85f38e4-e4f9-4460-9cef-1d22a9c153ab-de32c325-1432-48ec-bf62-4da198507df3" released by "_create_volume_from_snapshot" :: held 10.493s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.523s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.038s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-546200950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff750255-031f-4362-b653-39398ec6320d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2e328ee445d998926388034a04ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:45Z,use_quota=True,user_id='dd9565ba751245c09a8fcf989533ce20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Creating volume ff750255-031f-4362-b653-39398ec6320d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:45 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:45 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d 1073741824 Jul 07 09:27:45 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5dff327-2fe9-4d87-911b-e06d6a692e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de32c325-1432-48ec-bf62-4da198507df3', 'volume_size': 1, 'snapshot_id': 'f85f38e4-e4f9-4460-9cef-1d22a9c153ab'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa42622-274f-4726-9cf9-3f0088f1dee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:45 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Volume volume-de32c325-1432-48ec-bf62-4da198507df3 (de32c325-1432-48ec-bf62-4da198507df3): created successfully Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfa42622-274f-4726-9cf9-3f0088f1dee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Flow 'volume_create_manager' (a53e5c34-a6ab-4fca-b9db-a6ec447f65dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1d5464ad-151c-4740-aee2-43ab952062c7 tempest-VolumeDependencyTests-1609204448 None] Created volume successfully. Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-f85f38e4-e4f9-4460-9cef-1d22a9c153ab-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-f85f38e4-e4f9-4460-9cef-1d22a9c153ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-quobyte-28520da1-3e67-402b-be48-4de3c7843ed0" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-28520da1-3e67-402b-be48-4de3c7843ed0" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-quobyte-f85f38e4-e4f9-4460-9cef-1d22a9c153ab" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-f85f38e4-e4f9-4460-9cef-1d22a9c153ab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Deleting offline snapshot f85f38e4-e4f9-4460-9cef-1d22a9c153ab of volume 28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] snapshot_file for this snap is: volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3bc908-146a-4d62-a126-4c5c9a02cd17]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:46 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab Jul 07 09:27:46 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:46 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d 1073741824" returned: 0 in 0.969s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:46 devstack sudo[103565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d Jul 07 09:27:46 devstack sudo[103565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:46 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-28520da1-3e67-402b-be48-4de3c7843ed0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[589daebb-e346-484a-858b-f92cfeb2a7fa]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:46 devstack sudo[103565]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d" returned: 0 in 0.679s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a58bda72-b963-4e06-944a-1969224b9913) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff750255-031f-4362-b653-39398ec6320d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc6b769-fa6a-4e96-abc4-ccaf7667d1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Volume volume-ff750255-031f-4362-b653-39398ec6320d (ff750255-031f-4362-b653-39398ec6320d): created successfully Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc6b769-fa6a-4e96-abc4-ccaf7667d1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Flow 'volume_create_manager' (80edfe98-0c0a-46d6-b06c-85f721d3e233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:46 devstack sudo[103571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:46 devstack sudo[103571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b0dd3180-08f3-4e02-ab72-ed47f6f0f08c tempest-ProjectReaderTests-641976758 None] Created volume successfully. Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Acquiring lock "cinder-ff750255-031f-4362-b653-39398ec6320d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Lock "cinder-ff750255-031f-4362-b653-39398ec6320d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Acquiring lock "cinder-quobyte-ff750255-031f-4362-b653-39398ec6320d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Lock "cinder-quobyte-ff750255-031f-4362-b653-39398ec6320d" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[131c1efb-d25c-49aa-8bbf-30bd139fd025]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:47 devstack sudo[103576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d Jul 07 09:27:47 devstack sudo[103576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:47 devstack sudo[103571]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 0.861s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:47 devstack sudo[103584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab Jul 07 09:27:47 devstack sudo[103584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:48 devstack sudo[103576]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d" returned: 0 in 0.874s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:48 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d Jul 07 09:27:48 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:48 devstack sudo[103584]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab" returned: 0 in 0.804s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:48 devstack sudo[103595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab Jul 07 09:27:48 devstack sudo[103595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:48 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ff750255-031f-4362-b653-39398ec6320d" returned: 0 in 0.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Lock "cinder-quobyte-ff750255-031f-4362-b653-39398ec6320d" released by "delete_volume" :: held 1.634s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Created reservations ['40f4844d-0be6-4515-b829-dd937ced845a', '18fce76b-f134-4bd3-a54f-1da59c7508db', 'cf29fa04-4a96-40ab-bd3c-9e67c3d0c112', '0cc4de7b-8a72-413d-9b41-9ebcd4d699a7'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:49 devstack sudo[103595]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0.f85f38e4-e4f9-4460-9cef-1d22a9c153ab" returned: 0 in 0.680s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:49 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:49 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-f85f38e4-e4f9-4460-9cef-1d22a9c153ab" released by "_delete_snapshot" :: held 3.294s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-28520da1-3e67-402b-be48-4de3c7843ed0" released by "delete_snapshot" :: held 3.330s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Created reservations ['62005c47-96e4-4492-b665-8edd006ff127', '53acf81d-6bb4-4ef8-ab02-6017b0c5720f', 'eeb818c4-db06-4120-87ff-fd8f3e0dd5d9', '79343503-eecf-4054-bc53-10fe91f96bcb'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Delete snapshot completed successfully. Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c4f1cc1f-5850-4302-82a4-529ca3e56b72 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-f85f38e4-e4f9-4460-9cef-1d22a9c153ab-delete_snapshot" released by "delete_snapshot" :: held 3.486s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:49 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.688s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:49 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Deleted volume successfully. Jul 07 09:27:49 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b04662ca-5baa-4f95-8271-58a50a882eef tempest-ProjectReaderTests-641976758 None] Lock "cinder-ff750255-031f-4362-b653-39398ec6320d-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Flow 'volume_create_manager' (d9d683e7-36ca-47e0-a6e1-b29bede7612d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9c2055-6f98-48c9-af6b-96929db92edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b9c2055-6f98-48c9-af6b-96929db92edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1234333946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b4da21-7183-4e29-aca7-db4ee518b33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd4afe6bfd44627a0f8435a1dd23413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:50Z,use_quota=True,user_id='499d272055084523af7f88486112fee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7030d15-4ac4-42d2-8790-a99a3ea0494a),volume_type_id=d7030d15-4ac4-42d2-8790-a99a3ea0494a)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10986042-af6e-4434-afd4-38adbac3143a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10986042-af6e-4434-afd4-38adbac3143a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7ba57a-9a46-480c-af5a-14e824da8cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c7ba57a-9a46-480c-af5a-14e824da8cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b4da21-7183-4e29-aca7-db4ee518b33b', 'volume_name': 'volume-48b4da21-7183-4e29-aca7-db4ee518b33b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9296e9-6b6b-4e44-a7ce-1c191e51e1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc9296e9-6b6b-4e44-a7ce-1c191e51e1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a75f16f-8203-4f7b-aa5a-a4c21c6d7320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume 48b4da21-7183-4e29-aca7-db4ee518b33b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b4da21-7183-4e29-aca7-db4ee518b33b', 'volume_size': 1} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1234333946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b4da21-7183-4e29-aca7-db4ee518b33b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd4afe6bfd44627a0f8435a1dd23413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:50Z,use_quota=True,user_id='499d272055084523af7f88486112fee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7030d15-4ac4-42d2-8790-a99a3ea0494a),volume_type_id=d7030d15-4ac4-42d2-8790-a99a3ea0494a)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Creating volume 48b4da21-7183-4e29-aca7-db4ee518b33b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:50 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:50 devstack sudo[103603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b 1073741824 Jul 07 09:27:50 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-28520da1-3e67-402b-be48-4de3c7843ed0-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-28520da1-3e67-402b-be48-4de3c7843ed0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Flow 'volume_create_manager' (cad85717-b45b-415d-827a-bde3fe7e8438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d5bbab-1d28-4080-b66e-de73aba9e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8d5bbab-1d28-4080-b66e-de73aba9e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441886973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae21f44-ae90-40da-9077-93c6a8163807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2e328ee445d998926388034a04ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:50Z,use_quota=True,user_id='dd9565ba751245c09a8fcf989533ce20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d6a3fd-622c-4f2f-a2ae-e53a77790e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11d6a3fd-622c-4f2f-a2ae-e53a77790e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7272c9-ef9b-435f-b6ee-938a5b43ea2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db7272c9-ef9b-435f-b6ee-938a5b43ea2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae21f44-ae90-40da-9077-93c6a8163807', 'volume_name': 'volume-4ae21f44-ae90-40da-9077-93c6a8163807', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df70409f-7fb4-4854-972f-f913eb19cedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df70409f-7fb4-4854-972f-f913eb19cedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc59efb-cf68-4516-b736-66f5949eb671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Volume 4ae21f44-ae90-40da-9077-93c6a8163807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae21f44-ae90-40da-9077-93c6a8163807', 'volume_size': 1} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-quobyte-28520da1-3e67-402b-be48-4de3c7843ed0" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Flow 'volume_create_manager' (1fd0efbf-237b-43dc-a193-063b521f9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2807b1-9398-4798-ab3b-219c3ee83b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-28520da1-3e67-402b-be48-4de3c7843ed0" acquired by "delete_volume" :: waited 0.047s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab2807b1-9398-4798-ab3b-219c3ee83b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481869190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c999b923-7b66-4fee-9bb0-6309a4d850bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd4afe6bfd44627a0f8435a1dd23413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:50Z,use_quota=True,user_id='499d272055084523af7f88486112fee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6189da28-fdfd-4bbf-a3a0-ccf08d76ba44),volume_type_id=6189da28-fdfd-4bbf-a3a0-ccf08d76ba44)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3783410c-5daa-4292-afe6-987921977153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3783410c-5daa-4292-afe6-987921977153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443e5f88-7d39-4f18-a646-14aadb1a2191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (443e5f88-7d39-4f18-a646-14aadb1a2191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c999b923-7b66-4fee-9bb0-6309a4d850bf', 'volume_name': 'volume-c999b923-7b66-4fee-9bb0-6309a4d850bf', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162e365a-e88f-4c53-a274-85e6dc2bc790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (162e365a-e88f-4c53-a274-85e6dc2bc790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39bb27d-fdae-427d-b276-66fec1f0e6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume c999b923-7b66-4fee-9bb0-6309a4d850bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c999b923-7b66-4fee-9bb0-6309a4d850bf', 'volume_size': 1} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ce534-fc21-470c-97f8-0f59bdbe3d81]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:50 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:50 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:51 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b 1073741824" returned: 0 in 1.049s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Flow 'volume_create_manager' (bb66438d-d1a4-4917-ac98-70a00b3435f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952107e8-e498-4e19-b6ec-f30411570230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952107e8-e498-4e19-b6ec-f30411570230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2068211928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f85e7-f98f-46ba-a5d4-2ab29f266de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd4afe6bfd44627a0f8435a1dd23413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:51Z,use_quota=True,user_id='499d272055084523af7f88486112fee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c883584-2eb4-43ef-9c84-32f5876d3278),volume_type_id=1c883584-2eb4-43ef-9c84-32f5876d3278)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e787630-0b90-4d24-8d14-19926b7cfa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e787630-0b90-4d24-8d14-19926b7cfa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1483f2-9770-49ba-b8d5-d29931fbbfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:51 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b Jul 07 09:27:51 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:51 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b1483f2-9770-49ba-b8d5-d29931fbbfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '685f85e7-f98f-46ba-a5d4-2ab29f266de0', 'volume_name': 'volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0', 'volume_size': 1, 'image_id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1008896300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbd4afe6bfd44627a0f8435a1dd23413', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'created_at': datetime.datetime(2026, 7, 7, 7, 27, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65/file', 'properties': {}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a47fa05-1ebc-4c88-9a17-3dfeea6bc0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a47fa05-1ebc-4c88-9a17-3dfeea6bc0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1936faa-2256-4ac1-99b5-79a544f9d8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume 685f85e7-f98f-46ba-a5d4-2ab29f266de0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0', 'volume_size': 1, 'image_id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1008896300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbd4afe6bfd44627a0f8435a1dd23413', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'created_at': datetime.datetime(2026, 7, 7, 7, 27, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65/file', 'properties': {}}, 'image_service': } Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Trying to clone 685f85e7-f98f-46ba-a5d4-2ab29f266de0 from image a83ef4b4-b5ca-4390-b835-e67a66ed1d65 at location (None, [{'url': 'file:///opt/stack/data/glance/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 0.937s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:51 devstack sudo[103616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0 Jul 07 09:27:51 devstack sudo[103616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:52 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b" returned: 0 in 0.667s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.822s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.551s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1441886973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae21f44-ae90-40da-9077-93c6a8163807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38de2e328ee445d998926388034a04ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:50Z,use_quota=True,user_id='dd9565ba751245c09a8fcf989533ce20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Creating volume 4ae21f44-ae90-40da-9077-93c6a8163807 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:52 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:52 devstack sudo[103619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 1073741824 Jul 07 09:27:52 devstack sudo[103619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a75f16f-8203-4f7b-aa5a-a4c21c6d7320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b4da21-7183-4e29-aca7-db4ee518b33b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f271770-28d2-4cfa-b4f2-2a9cffdedcfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:52 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume volume-48b4da21-7183-4e29-aca7-db4ee518b33b (48b4da21-7183-4e29-aca7-db4ee518b33b): created successfully Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f271770-28d2-4cfa-b4f2-2a9cffdedcfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Flow 'volume_create_manager' (d9d683e7-36ca-47e0-a6e1-b29bede7612d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:52 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9e74ab27-b123-4cd4-bc1a-55b1abf0b1f9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Created volume successfully. Jul 07 09:27:52 devstack sudo[103616]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-28520da1-3e67-402b-be48-4de3c7843ed0" returned: 0 in 0.708s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-28520da1-3e67-402b-be48-4de3c7843ed0" released by "delete_volume" :: held 1.786s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Created reservations ['6cf12aed-0ad4-48e7-b0a9-5762d22719fd', 'ae75b587-9661-48ba-a826-795140a80b85', 'cbb6dac0-e970-47d8-bdf3-94c51de10a1a', '907705f3-c82d-45f3-96c6-fdea6104d06d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:52 devstack sudo[103622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:52 devstack sudo[103622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-de32c325-1432-48ec-bf62-4da198507df3-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-de32c325-1432-48ec-bf62-4da198507df3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "cinder-quobyte-de32c325-1432-48ec-bf62-4da198507df3" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-de32c325-1432-48ec-bf62-4da198507df3" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee2ec73-8d48-47b9-89b6-ffdbe3df7e00]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:52 devstack sudo[103627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 Jul 07 09:27:52 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:52 devstack sudo[103619]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 1073741824" returned: 0 in 0.942s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:53 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 Jul 07 09:27:53 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:53 devstack sudo[103622]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Deleted volume successfully. Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c247a6ac-d60e-475f-a528-d0b9c8e8db45 tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-28520da1-3e67-402b-be48-4de3c7843ed0-delete_volume" released by "delete_volume" :: held 3.059s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:53 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3" returned: 0 in 0.933s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:53 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3 Jul 07 09:27:53 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:53 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807" returned: 0 in 0.787s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.159s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1481869190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c999b923-7b66-4fee-9bb0-6309a4d850bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd4afe6bfd44627a0f8435a1dd23413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:50Z,use_quota=True,user_id='499d272055084523af7f88486112fee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6189da28-fdfd-4bbf-a3a0-ccf08d76ba44),volume_type_id=6189da28-fdfd-4bbf-a3a0-ccf08d76ba44)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Creating volume c999b923-7b66-4fee-9bb0-6309a4d850bf {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:53 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:53 devstack sudo[103639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf 1073741824 Jul 07 09:27:53 devstack sudo[103639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc59efb-cf68-4516-b736-66f5949eb671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae21f44-ae90-40da-9077-93c6a8163807', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084b0e02-0bfa-4f87-a85c-2940394cb83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:53 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Volume volume-4ae21f44-ae90-40da-9077-93c6a8163807 (4ae21f44-ae90-40da-9077-93c6a8163807): created successfully Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (084b0e02-0bfa-4f87-a85c-2940394cb83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Flow 'volume_create_manager' (cad85717-b45b-415d-827a-bde3fe7e8438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a190b83c-9929-4ce7-ae96-4eb0ad34cae7 tempest-ProjectReaderTests-641976758 None] Created volume successfully. Jul 07 09:27:54 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-de32c325-1432-48ec-bf62-4da198507df3" returned: 0 in 0.762s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-quobyte-de32c325-1432-48ec-bf62-4da198507df3" released by "delete_volume" :: held 1.739s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Created reservations ['a8a2589d-6524-42fe-8f20-613340ac7655', '9714b840-4d0b-4cf1-a025-79b0d442baeb', 'b9448ee9-0d62-42c0-ab71-dd0f9479bf14', '380aab32-f7fd-4fb4-b3b0-2edf959858a2'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:54 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:54 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Acquiring lock "cinder-4ae21f44-ae90-40da-9077-93c6a8163807-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Lock "cinder-4ae21f44-ae90-40da-9077-93c6a8163807-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Acquiring lock "cinder-quobyte-4ae21f44-ae90-40da-9077-93c6a8163807" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Lock "cinder-quobyte-4ae21f44-ae90-40da-9077-93c6a8163807" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a798b2c-f3b0-4f0c-a356-eb63f6c04bd0]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:54 devstack sudo[103639]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf 1073741824" returned: 0 in 1.043s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:54 devstack sudo[103648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 Jul 07 09:27:54 devstack sudo[103648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:54 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf Jul 07 09:27:54 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:55 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.875s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Deleted volume successfully. Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-eb699d55-3f32-47ce-8861-86e1e854098c tempest-VolumeDependencyTests-1609204448 None] Lock "cinder-de32c325-1432-48ec-bf62-4da198507df3-delete_volume" released by "delete_volume" :: held 2.921s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:55 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf" returned: 0 in 0.791s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b39bb27d-fdae-427d-b276-66fec1f0e6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c999b923-7b66-4fee-9bb0-6309a4d850bf', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6939ec4f-f3c2-43a8-8ef6-9e39d9824881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:27:55 devstack sudo[103648]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807" returned: 0 in 0.985s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:55 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume volume-c999b923-7b66-4fee-9bb0-6309a4d850bf (c999b923-7b66-4fee-9bb0-6309a4d850bf): created successfully Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6939ec4f-f3c2-43a8-8ef6-9e39d9824881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:27:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Flow 'volume_create_manager' (1fd0efbf-237b-43dc-a193-063b521f9884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:27:55 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807 Jul 07 09:27:55 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e3faaed8-e1d0-4ec3-8495-3d26e6733a2e tempest-TestInstancesWithCinderVolumes-2003726541 None] Created volume successfully. Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD, size 20.69 MB, duration 4.50 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:27:56 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Image download 20.69 MB at 4.60 MB/s Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09404b7-44bd-43de-a84e-d163eb1e5bd3]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:56 devstack sudo[103659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD Jul 07 09:27:56 devstack sudo[103659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:56 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-4ae21f44-ae90-40da-9077-93c6a8163807" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Lock "cinder-quobyte-4ae21f44-ae90-40da-9077-93c6a8163807" released by "delete_volume" :: held 1.749s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Created reservations ['bcdbee07-fe39-4a7b-b953-3034675d784f', '9f3ea53e-8699-497e-be02-e772a4444177', '365e04b1-2c82-4786-89c0-f61b4e93c690', '65ceac9b-6c4a-4049-a903-94a8c1c60f8f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:56 devstack sudo[103662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:27:56 devstack sudo[103662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:56 devstack sudo[103659]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:56 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Temporary image a83ef4b4-b5ca-4390-b835-e67a66ed1d65 is fetched for user 499d272055084523af7f88486112fee8. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c95e5-3ccd-4166-89c1-a4acb5514aa6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:57 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD Jul 07 09:27:57 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:57 devstack sudo[103662]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.765s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:27:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Deleted volume successfully. Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb415a8-03eb-4b13-b3f2-bca8dcbdb34f tempest-ProjectReaderTests-641976758 None] Lock "cinder-4ae21f44-ae90-40da-9077-93c6a8163807-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:27:57 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD" returned: 0 in 0.893s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2068211928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=685f85e7-f98f-46ba-a5d4-2ab29f266de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bbd4afe6bfd44627a0f8435a1dd23413',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:27:51Z,use_quota=True,user_id='499d272055084523af7f88486112fee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c883584-2eb4-43ef-9c84-32f5876d3278),volume_type_id=1c883584-2eb4-43ef-9c84-32f5876d3278)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Creating volume 685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:27:57 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:27:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:57 devstack sudo[103673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 1073741824 Jul 07 09:27:57 devstack sudo[103673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:58 devstack sudo[103673]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 1073741824" returned: 0 in 0.957s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:58 devstack sudo[103679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:27:58 devstack sudo[103679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:27:59 devstack sudo[103679]: pam_unix(sudo:session): session closed for user root Jul 07 09:27:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 0 in 0.718s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:27:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:27:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:27:59 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Attempting download of a83ef4b4-b5ca-4390-b835-e67a66ed1d65 ((None, [{'url': 'file:///opt/stack/data/glance/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'metadata': {}}])) to volume 685f85e7-f98f-46ba-a5d4-2ab29f266de0. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:27:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1526f3-2e4b-4f55-bfe8-95d9f8e65f5a]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:27:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:27:59 devstack sudo[103682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x Jul 07 09:27:59 devstack sudo[103682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:00 devstack sudo[103682]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x" returned: 0 in 0.863s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:00 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x Jul 07 09:28:00 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:01 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x" returned: 1 in 0.799s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_ewqofq4x' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:28:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7866b8a5-c685-4469-a1c0-2269e238e9dc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:28:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:01 devstack sudo[103690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD Jul 07 09:28:01 devstack sudo[103690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:02 devstack sudo[103690]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:02 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] a83ef4b4-b5ca-4390-b835-e67a66ed1d65 was qcow2, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:28:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:02 devstack sudo[103696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:28:02 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:04 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 0 in 2.038s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:04 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a83ef4b4-b5ca-4390-b835-e67a66ed1d65_16507wdidevstack@QuobyteHD, size 112.00 MB, duration 2.04 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:28:04 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Converted 112.00 MB image at 54.91 MB/s Jul 07 09:28:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:04 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 1G Jul 07 09:28:04 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:05 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 1G" returned: 0 in 0.685s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad6caa3-005b-4c86-970f-0a5e17c7dc68]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:28:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:05 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:28:05 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:05 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:05 devstack sudo[103715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:28:05 devstack sudo[103715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:06 devstack sudo[103715]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 1 in 0.810s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Downloaded image a83ef4b4-b5ca-4390-b835-e67a66ed1d65 ((None, [{'url': 'file:///opt/stack/data/glance/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'metadata': {}}])) to volume 685f85e7-f98f-46ba-a5d4-2ab29f266de0 successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Temporary image a83ef4b4-b5ca-4390-b835-e67a66ed1d65 for user 499d272055084523af7f88486112fee8 is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Marking volume 685f85e7-f98f-46ba-a5d4-2ab29f266de0 as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Copying metadata from image a83ef4b4-b5ca-4390-b835-e67a66ed1d65 to 685f85e7-f98f-46ba-a5d4-2ab29f266de0. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Creating volume glance metadata for volume 685f85e7-f98f-46ba-a5d4-2ab29f266de0 backed by image a83ef4b4-b5ca-4390-b835-e67a66ed1d65 with: {'image_id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'image_name': 'tempest-scenario-img--1008896300', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1936faa-2256-4ac1-99b5-79a544f9d8ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0', 'volume_size': 1, 'image_id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1008896300', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bbd4afe6bfd44627a0f8435a1dd23413', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'a83ef4b4-b5ca-4390-b835-e67a66ed1d65', 'created_at': datetime.datetime(2026, 7, 7, 7, 27, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a83ef4b4-b5ca-4390-b835-e67a66ed1d65/file', 'properties': {}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5964023a-1064-4286-a63e-ec0597b4a5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:28:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Volume volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 (685f85e7-f98f-46ba-a5d4-2ab29f266de0): created successfully Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5964023a-1064-4286-a63e-ec0597b4a5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:28:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Flow 'volume_create_manager' (bb66438d-d1a4-4917-ac98-70a00b3435f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:28:06 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-627ea6d1-b77f-42a4-9ba8-1bfa84ce87d9 tempest-TestInstancesWithCinderVolumes-2003726541 None] Created volume successfully. Jul 07 09:28:15 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=97,cinder:INSERT=29,cinder:UPDATE=129,cinder:DELETE=4 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:28:15 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=98,cinder:INSERT=42,cinder:UPDATE=120,cinder:DELETE=16 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:28:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:28:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:28:15 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[56895bca-293f-4645-ac9b-670767403b89]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:28:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:15 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:28:15 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:16 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 0 in 0.763s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:16 devstack sudo[103742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:28:16 devstack sudo[103742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:16 devstack sudo[103742]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 1 in 0.737s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:28:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.550s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:28:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05f4ed17-a184-41ee-960e-81f7706d24a1', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:28:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-6468a916-5986-4762-aa7a-aa7221e86ceb req-e1d2b870-d775-47fc-b135-c7b13d4ccffb tempest-TestInstancesWithCinderVolumes-2003726541 None] attachment_update completed successfully. Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=5 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:28:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:26 devstack sudo[104194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:28:26 devstack sudo[104194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:27 devstack sudo[104194]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.839s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:28:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:28:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:28:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:28:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:28:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:28:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d02c698-3a3f-44ae-8dcd-2300ff2fab20]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:28:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:28:52 devstack sudo[104353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b Jul 07 09:28:52 devstack sudo[104353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:28:53 devstack sudo[104353]: pam_unix(sudo:session): session closed for user root Jul 07 09:28:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b" returned: 0 in 0.752s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:28:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.768s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:28:53 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-48b4da21-7183-4e29-aca7-db4ee518b33b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52528c23-4323-4901-9596-8f1ba513b89e', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:28:53 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-e169054d-9a6f-43c0-8aff-463ca0a1069b req-37ad808a-735c-472a-a485-c1ab6c756205 tempest-TestInstancesWithCinderVolumes-2003726541 None] attachment_update completed successfully. Jul 07 09:29:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:29:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:29:00 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bd3a23-8f33-4e08-8ab7-4bce0cd6ba05]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:29:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:00 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf Jul 07 09:29:00 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:01 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf" returned: 0 in 0.750s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:29:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-c999b923-7b66-4fee-9bb0-6309a4d850bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae48f6e3-ace6-4d68-8e70-4dbd41a06c8e', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:29:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-5b3f5cb0-2819-4b33-8c51-c55475663710 req-55364fd2-efeb-45f4-9971-5800c1eee925 tempest-TestInstancesWithCinderVolumes-2003726541 None] attachment_update completed successfully. Jul 07 09:29:09 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-50f0460d-4ed3-4f2d-a75b-b3c2128438bf req-5fdd2463-d816-471f-9d94-7ef8e79ed135 tempest-TestInstancesWithCinderVolumes-2003726541 None] Terminate volume connection completed successfully. Jul 07 09:29:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-50f0460d-4ed3-4f2d-a75b-b3c2128438bf req-5fdd2463-d816-471f-9d94-7ef8e79ed135 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deleting attachment 52528c23-4323-4901-9596-8f1ba513b89e. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:29:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "cinder-48b4da21-7183-4e29-aca7-db4ee518b33b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:29:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-48b4da21-7183-4e29-aca7-db4ee518b33b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:29:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "cinder-quobyte-48b4da21-7183-4e29-aca7-db4ee518b33b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:29:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-quobyte-48b4da21-7183-4e29-aca7-db4ee518b33b" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:29:12 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff526af6-107b-4983-9a4f-eaa31c845dca]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:29:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:12 devstack sudo[104426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b Jul 07 09:29:12 devstack sudo[104426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:12 devstack sudo[104426]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b" returned: 0 in 0.775s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:12 devstack sudo[104431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b Jul 07 09:29:12 devstack sudo[104431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:13 devstack sudo[104431]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-48b4da21-7183-4e29-aca7-db4ee518b33b" returned: 0 in 0.719s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-quobyte-48b4da21-7183-4e29-aca7-db4ee518b33b" released by "delete_volume" :: held 1.530s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:29:13 devstack cinder-volume[86769]: WARNING cinder.quota [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405051104-34515610 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405051104-34515610, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:29:13 devstack cinder-volume[86769]: WARNING cinder.quota [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405051104-34515610 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-405051104-34515610, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Created reservations ['146d5132-078c-4641-9b31-d4abd21d0b6a', '2737fc45-8c42-4f2a-9f56-0d688de42053', 'f436a726-d664-4969-a388-351b3da8ad81', '7b080af3-ea27-44ed-92c7-42c97381a8af'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:29:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:13 devstack sudo[104438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:29:13 devstack sudo[104438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:14 devstack sudo[104438]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.664s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:14 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:29:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deleted volume successfully. Jul 07 09:29:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6e304927-6b24-4210-87a6-d77a539c7c35 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-48b4da21-7183-4e29-aca7-db4ee518b33b-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:29:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-d763ba1e-21f9-4e51-9731-02d89a26d18b req-e0754547-8788-4450-acda-36d92efad6cc tempest-TestInstancesWithCinderVolumes-2003726541 None] Terminate volume connection completed successfully. Jul 07 09:29:16 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-d763ba1e-21f9-4e51-9731-02d89a26d18b req-e0754547-8788-4450-acda-36d92efad6cc tempest-TestInstancesWithCinderVolumes-2003726541 None] Deleting attachment ae48f6e3-ace6-4d68-8e70-4dbd41a06c8e. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "cinder-c999b923-7b66-4fee-9bb0-6309a4d850bf-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-c999b923-7b66-4fee-9bb0-6309a4d850bf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "cinder-quobyte-c999b923-7b66-4fee-9bb0-6309a4d850bf" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-quobyte-c999b923-7b66-4fee-9bb0-6309a4d850bf" acquired by "delete_volume" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[86dd1767-89e6-4fd7-a8b4-5ed90f83ef2e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:18 devstack sudo[104459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf Jul 07 09:29:18 devstack sudo[104459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:18 devstack sudo[104459]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf" returned: 0 in 0.798s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:18 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf Jul 07 09:29:18 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:19 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-c999b923-7b66-4fee-9bb0-6309a4d850bf" returned: 0 in 0.718s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-quobyte-c999b923-7b66-4fee-9bb0-6309a4d850bf" released by "delete_volume" :: held 1.556s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:29:19 devstack cinder-volume[86769]: WARNING cinder.quota [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1744178802-1216718650 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1744178802-1216718650, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:29:19 devstack cinder-volume[86769]: WARNING cinder.quota [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1744178802-1216718650 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1744178802-1216718650, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Created reservations ['dcbffab4-32ba-4b22-bf48-43fb69123635', '5773f914-e926-48dd-bbec-50051542103d', '62382262-8281-4c9c-bbaf-156c1f5d711a', '262794d7-86c7-4e8d-8259-711b64707dae'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:29:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:19 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:29:19 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:20 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.715s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:20 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:29:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Deleted volume successfully. Jul 07 09:29:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8f24d189-1c63-4141-90bc-e18824aa963b tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-c999b923-7b66-4fee-9bb0-6309a4d850bf-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:29:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-8d392611-3c8c-4551-91e9-d7204050c1fd req-c10d0f8d-84f1-4246-bf4f-c07fb5bab28b tempest-TestInstancesWithCinderVolumes-2003726541 None] Terminate volume connection completed successfully. Jul 07 09:29:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-8d392611-3c8c-4551-91e9-d7204050c1fd req-c10d0f8d-84f1-4246-bf4f-c07fb5bab28b tempest-TestInstancesWithCinderVolumes-2003726541 None] Deleting attachment 05f4ed17-a184-41ee-960e-81f7706d24a1. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:29:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:26 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:29:26 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "cinder-685f85e7-f98f-46ba-a5d4-2ab29f266de0-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-685f85e7-f98f-46ba-a5d4-2ab29f266de0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "cinder-quobyte-685f85e7-f98f-46ba-a5d4-2ab29f266de0" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:29:27 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.653s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-quobyte-685f85e7-f98f-46ba-a5d4-2ab29f266de0" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a55fc6-ca2d-46a5-aba0-e5a7f3f5a2ce]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:29:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:27 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:29:27 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:28 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 0 in 0.723s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:28 devstack sudo[104508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:29:28 devstack sudo[104508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:29 devstack sudo[104508]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 1 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:29 devstack sudo[104513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0 Jul 07 09:29:29 devstack sudo[104513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:29 devstack sudo[104513]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-685f85e7-f98f-46ba-a5d4-2ab29f266de0" returned: 0 in 0.624s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-quobyte-685f85e7-f98f-46ba-a5d4-2ab29f266de0" released by "delete_volume" :: held 2.128s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:29:29 devstack cinder-volume[86769]: WARNING cinder.quota [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1048100853-492295785 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1048100853-492295785, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:29:29 devstack cinder-volume[86769]: WARNING cinder.quota [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1048100853-492295785 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1048100853-492295785, it is now deprecated. Please use the default quota class for default quota. Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Created reservations ['d4aec464-fc6a-4268-9d3c-40ddf558db35', '02a94cc9-6e31-47aa-866f-e38d5713967d', 'ccc48237-fabd-4aa4-b125-14ecb41fca8c', 'af9918a6-0963-4e4c-80ac-fb581701423c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:29:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:29:29 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:29:29 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:29:30 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Jul 07 09:29:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.615s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:29:30 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:29:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Deleted volume successfully. Jul 07 09:29:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5292b1e2-0820-42c5-b4fd-57586ce54029 tempest-TestInstancesWithCinderVolumes-2003726541 None] Lock "cinder-685f85e7-f98f-46ba-a5d4-2ab29f266de0-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:29:39 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:29:40 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:30:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Flow 'volume_create_manager' (5e806f25-1c28-4661-988c-bf25848348a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cec143-4fa5-4d19-ad20-562af7790f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1cec143-4fa5-4d19-ad20-562af7790f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1206030685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47305cd5-5775-4b38-86df-96d3e243103a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3bb2ef9e4d48cd8ebb05ea2e2294cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:30:02Z,use_quota=True,user_id='90d71c1d158d43b593e68f8be2837ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fad74f-15c2-4d29-8eec-ac553d0cbde8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5fad74f-15c2-4d29-8eec-ac553d0cbde8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9918499-b2ab-4acc-b9a1-39c37b8bd269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9918499-b2ab-4acc-b9a1-39c37b8bd269) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '47305cd5-5775-4b38-86df-96d3e243103a', 'volume_name': 'volume-47305cd5-5775-4b38-86df-96d3e243103a', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b52a4cd-68fb-4803-94fe-ca0d6258e620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b52a4cd-68fb-4803-94fe-ca0d6258e620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fd9f7d-a001-4e69-a4e6-9289c924ce0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:30:02 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Volume 47305cd5-5775-4b38-86df-96d3e243103a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-47305cd5-5775-4b38-86df-96d3e243103a', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Trying to clone 47305cd5-5775-4b38-86df-96d3e243103a from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:30:02 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Image download 20.69 MB at 20.69 MB/s Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a2de5b1-d728-4028-a753-16c621b13d6c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:30:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:02 devstack sudo[104573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD Jul 07 09:30:02 devstack sudo[104573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:03 devstack sudo[104573]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:03 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 is fetched for user 90d71c1d158d43b593e68f8be2837ef3. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:30:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f66dcbc-3e93-4289-9b21-f36b77ae2286]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:30:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:03 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD Jul 07 09:30:03 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:04 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD" returned: 0 in 0.719s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1206030685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47305cd5-5775-4b38-86df-96d3e243103a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b3bb2ef9e4d48cd8ebb05ea2e2294cb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:30:02Z,use_quota=True,user_id='90d71c1d158d43b593e68f8be2837ef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Creating volume 47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:30:04 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:30:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:04 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a 1073741824 Jul 07 09:30:04 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:05 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a 1073741824" returned: 0 in 0.815s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:05 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:30:05 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:05 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 0.639s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Attempting download of 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume 47305cd5-5775-4b38-86df-96d3e243103a. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36d5fa-16db-454d-bff3-1a9317c07659]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:30:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:05 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x Jul 07 09:30:05 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:06 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x" returned: 0 in 0.722s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:06 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x Jul 07 09:30:06 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:07 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x" returned: 1 in 0.714s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_nq41il2x' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:30:07 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f5390c-5f54-4c36-b5af-4a08549402b9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:30:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:07 devstack sudo[104603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD Jul 07 09:30:07 devstack sudo[104603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:08 devstack sudo[104603]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD" returned: 0 in 0.726s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:08 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 was qcow2, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:30:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:08 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:30:08 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:09 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 1.725s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:09 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90ae4856-bfbe-4e57-9a2c-cf85a0251e28_10ezz9tidevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:30:09 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Converted 112.00 MB image at 64.87 MB/s Jul 07 09:30:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:09 devstack sudo[104621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a 1G Jul 07 09:30:09 devstack sudo[104621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:10 devstack sudo[104621]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a 1G" returned: 0 in 0.709s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:10 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[285a78f7-cdb1-4a37-addd-020c664ff69a]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:30:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:10 devstack sudo[104626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:30:10 devstack sudo[104626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:11 devstack sudo[104626]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 0.735s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:11 devstack sudo[104630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:30:11 devstack sudo[104630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:11 devstack sudo[104630]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 1 in 0.740s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Downloaded image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 ((None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}])) to volume 47305cd5-5775-4b38-86df-96d3e243103a successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Temporary image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 for user 90d71c1d158d43b593e68f8be2837ef3 is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Marking volume 47305cd5-5775-4b38-86df-96d3e243103a as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Copying metadata from image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 to 47305cd5-5775-4b38-86df-96d3e243103a. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:30:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Creating volume glance metadata for volume 47305cd5-5775-4b38-86df-96d3e243103a backed by image 90ae4856-bfbe-4e57-9a2c-cf85a0251e28 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:30:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7fd9f7d-a001-4e69-a4e6-9289c924ce0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47305cd5-5775-4b38-86df-96d3e243103a', 'volume_size': 1, 'image_id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '445622d634ca47b5b37def360a5eca6e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90ae4856-bfbe-4e57-9a2c-cf85a0251e28', 'created_at': datetime.datetime(2026, 7, 7, 7, 4, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 4, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90ae4856-bfbe-4e57-9a2c-cf85a0251e28/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:30:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a97d34-d735-4825-86bb-bea40255115d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:30:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Volume volume-47305cd5-5775-4b38-86df-96d3e243103a (47305cd5-5775-4b38-86df-96d3e243103a): created successfully Jul 07 09:30:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86a97d34-d735-4825-86bb-bea40255115d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:30:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Flow 'volume_create_manager' (5e806f25-1c28-4661-988c-bf25848348a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:30:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b2127302-e04f-41b0-8a66-763c1d755653 tempest-TestShelveInstance-485969243 None] Created volume successfully. Jul 07 09:30:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:30:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:30:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d43ea8-e954-4ede-8bc2-68e2e5d064eb]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:30:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:19 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:30:19 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:20 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 0.793s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:20 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:30:20 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:21 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 1 in 0.734s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:30:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.570s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:30:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-47305cd5-5775-4b38-86df-96d3e243103a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dd44ef33-0ad5-4061-ab77-3c6f59cfa7c6', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:30:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-edf40405-18dc-4e4e-8774-8b63113e3a78 req-5f7769fe-b85a-4745-8cd7-2e119b72d7ef tempest-TestShelveInstance-485969243 None] attachment_update completed successfully. Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:30:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:30:26 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:30:26 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:30:27 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Jul 07 09:30:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.651s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:30:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:30:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:30:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:30:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:30:31 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=4,cinder:SELECT=16,cinder:INSERT=9 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:30:31 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=14,cinder:UPDATE=8,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:30:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-a1dcc6c7-ffdb-41b6-b244-68d453e9efe3 req-aaac749c-d715-41a0-bb40-263c80fd6b19 tempest-TestShelveInstance-485969243 None] Terminate volume connection completed successfully. Jul 07 09:30:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-a1dcc6c7-ffdb-41b6-b244-68d453e9efe3 req-aaac749c-d715-41a0-bb40-263c80fd6b19 tempest-TestShelveInstance-485969243 None] Deleting attachment dd44ef33-0ad5-4061-ab77-3c6f59cfa7c6. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:31:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:31:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:31:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd2c2ae-69ed-453a-86f2-10c5c323a15c]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:31:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:01 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:31:01 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:02 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 0.732s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:02 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:31:02 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:03 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 1 in 0.769s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:31:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.543s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:31:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68', 'name': 'volume-47305cd5-5775-4b38-86df-96d3e243103a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8b25b43d-22e7-4649-bb25-2a6672f9d3f4', 'enforce_multipath': True} {{(pid=86769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4936}} Jul 07 09:31:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-4ac9a24f-f13c-4378-81cd-138e926622cb req-f79957b3-630a-449a-b0e8-04015edf3c34 tempest-TestShelveInstance-485969243 None] attachment_update completed successfully. Jul 07 09:31:13 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=5,cinder:UPDATE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:31:13 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:31:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:26 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:31:26 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:27 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.664s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:31:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:31:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:31:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:31:36 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:31:36 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:31:42 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b4900adc-9f9c-42f7-83cb-3598ccc8031b tempest-TestShelveInstance-485969243 None] Terminate volume connection completed successfully. Jul 07 09:31:42 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b4900adc-9f9c-42f7-83cb-3598ccc8031b tempest-TestShelveInstance-485969243 None] Deleting attachment 8b25b43d-22e7-4649-bb25-2a6672f9d3f4. {{(pid=86769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5067}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Acquiring lock "cinder-47305cd5-5775-4b38-86df-96d3e243103a-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Lock "cinder-47305cd5-5775-4b38-86df-96d3e243103a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Acquiring lock "cinder-quobyte-47305cd5-5775-4b38-86df-96d3e243103a" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Lock "cinder-quobyte-47305cd5-5775-4b38-86df-96d3e243103a" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3437eada-4b6e-4282-9a6f-46b9c8f836e4]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:43 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:31:43 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:43 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 0.765s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:44 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:31:44 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:44 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 1 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:31:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:44 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a Jul 07 09:31:44 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:45 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-47305cd5-5775-4b38-86df-96d3e243103a" returned: 0 in 0.639s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Lock "cinder-quobyte-47305cd5-5775-4b38-86df-96d3e243103a" released by "delete_volume" :: held 2.210s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG cinder.quota [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Created reservations ['be629a82-e57e-472b-a097-9ecba596d4da', '17034776-1585-42c3-a9e0-35af5290add5', '1d1b4fde-ec79-4c67-b980-7bd7e27ed7bd', '9f089d3b-89d5-4de9-963e-3ed8a12e5d29'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:31:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:45 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:31:45 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:46 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.660s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:46 devstack cinder-volume[86769]: DEBUG cinder.manager [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:31:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Deleted volume successfully. Jul 07 09:31:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [req-69227f04-8801-434b-a9f9-95cecdbc29de req-b08eae0b-322d-409d-85b5-1a3f8e38799d tempest-TestShelveInstance-485969243 None] Lock "cinder-47305cd5-5775-4b38-86df-96d3e243103a-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:31:55 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=7,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (d1aeca18-0248-48b0-b83e-18065728ba2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f282fd-8bb4-4572-9575-e16faad0e584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17f282fd-8bb4-4572-9575-e16faad0e584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875112382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6ce872-4992-4fde-b085-42daf0a4a86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:31:57Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7ad295-52bf-450d-bdbb-25886b012f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c7ad295-52bf-450d-bdbb-25886b012f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b5dcf5-6fa4-48f7-9f9f-3b80a8a8bbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06b5dcf5-6fa4-48f7-9f9f-3b80a8a8bbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6ce872-4992-4fde-b085-42daf0a4a86e', 'volume_name': 'volume-ae6ce872-4992-4fde-b085-42daf0a4a86e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf10b81-333b-483c-b0df-c68bb419afb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf10b81-333b-483c-b0df-c68bb419afb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491f92fa-2a55-4712-b3e9-e45279dbf5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:31:56 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Volume ae6ce872-4992-4fde-b085-42daf0a4a86e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6ce872-4992-4fde-b085-42daf0a4a86e', 'volume_size': 1} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:31:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875112382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6ce872-4992-4fde-b085-42daf0a4a86e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:31:57Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Creating volume ae6ce872-4992-4fde-b085-42daf0a4a86e {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:31:56 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:31:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:56 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e 1073741824 Jul 07 09:31:56 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:57 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e 1073741824" returned: 0 in 0.782s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:57 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e Jul 07 09:31:57 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:58 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e" returned: 0 in 0.625s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] <== create_volume: return (1444ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (491f92fa-2a55-4712-b3e9-e45279dbf5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6ce872-4992-4fde-b085-42daf0a4a86e', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1df9daa-9b15-4fca-8da9-a3cc97d92085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:31:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Volume volume-ae6ce872-4992-4fde-b085-42daf0a4a86e (ae6ce872-4992-4fde-b085-42daf0a4a86e): created successfully Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1df9daa-9b15-4fca-8da9-a3cc97d92085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (d1aeca18-0248-48b0-b83e-18065728ba2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:31:58 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2dc3cb35-ca44-4cbf-b5d7-3d64e4fa0396 tempest-ProjectReaderTests-1676441012 None] Created volume successfully. Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-ae6ce872-4992-4fde-b085-42daf0a4a86e-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-ae6ce872-4992-4fde-b085-42daf0a4a86e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-quobyte-ae6ce872-4992-4fde-b085-42daf0a4a86e" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-ae6ce872-4992-4fde-b085-42daf0a4a86e" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e5711d-359c-4235-8c4c-971c41a66baa]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:31:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:59 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e Jul 07 09:31:59 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:31:59 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Jul 07 09:31:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e" returned: 0 in 0.722s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:31:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:31:59 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e Jul 07 09:31:59 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:00 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ae6ce872-4992-4fde-b085-42daf0a4a86e" returned: 0 in 0.617s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-ae6ce872-4992-4fde-b085-42daf0a4a86e" released by "delete_volume" :: held 1.378s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Created reservations ['81331931-1bc1-4bfb-9921-249fe6e0558e', '239a984d-5081-4044-b1ad-db6d3fb40b41', 'c4951737-b9e9-4d10-8823-59ec0a673c9a', 'd30e0ac4-47e4-42f9-8c58-6621b10f9461'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:00 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:00 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:01 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.642s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Deleted volume successfully. Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0b4c8771-e319-4e55-9d10-7c8506fd2307 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-ae6ce872-4992-4fde-b085-42daf0a4a86e-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (7036e834-8a4d-4baf-86d1-b65a76e7e270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692f5f85-ff23-498d-8a52-11c6ba726c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (692f5f85-ff23-498d-8a52-11c6ba726c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903201865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9877e7-9281-4d93-a209-59f2652a8cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:01Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218cda90-5dac-400a-939e-ec2b745e95cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218cda90-5dac-400a-939e-ec2b745e95cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0fe586-673b-419f-9b33-b45b72c06b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f0fe586-673b-419f-9b33-b45b72c06b3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f9877e7-9281-4d93-a209-59f2652a8cb2', 'volume_name': 'volume-5f9877e7-9281-4d93-a209-59f2652a8cb2', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60968f01-10b8-44e2-9927-5b0c0b3e9f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60968f01-10b8-44e2-9927-5b0c0b3e9f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace6b799-3e0d-4a40-9860-200de75e5181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:01 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Volume 5f9877e7-9281-4d93-a209-59f2652a8cb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f9877e7-9281-4d93-a209-59f2652a8cb2', 'volume_size': 1} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-903201865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f9877e7-9281-4d93-a209-59f2652a8cb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:01Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Creating volume 5f9877e7-9281-4d93-a209-59f2652a8cb2 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:32:01 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:32:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:01 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 1073741824 Jul 07 09:32:01 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:02 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 1073741824" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:02 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 Jul 07 09:32:02 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:03 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2" returned: 0 in 0.614s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace6b799-3e0d-4a40-9860-200de75e5181) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f9877e7-9281-4d93-a209-59f2652a8cb2', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2212179-2dfb-49d2-aae9-328acb89c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:03 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Volume volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 (5f9877e7-9281-4d93-a209-59f2652a8cb2): created successfully Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2212179-2dfb-49d2-aae9-328acb89c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (7036e834-8a4d-4baf-86d1-b65a76e7e270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b9e859c3-1bdc-4f73-bf3a-c53a7881baae tempest-ProjectReaderTests-1676441012 None] Created volume successfully. Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-5f9877e7-9281-4d93-a209-59f2652a8cb2-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-5f9877e7-9281-4d93-a209-59f2652a8cb2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-quobyte-5f9877e7-9281-4d93-a209-59f2652a8cb2" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-5f9877e7-9281-4d93-a209-59f2652a8cb2" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac4d7b0-47cd-4626-93da-ef4167d69ef9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:03 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 Jul 07 09:32:03 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:04 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2" returned: 0 in 0.720s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:04 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2 Jul 07 09:32:04 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:05 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-5f9877e7-9281-4d93-a209-59f2652a8cb2" returned: 0 in 0.616s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-5f9877e7-9281-4d93-a209-59f2652a8cb2" released by "delete_volume" :: held 1.373s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Created reservations ['6a950d49-11d4-4629-aaf5-6cef2e9be64a', '2cfe46cb-87d4-4b12-b1cb-fdc0f97931f6', 'af83e2da-4374-4f5d-87e4-e69215d9485a', '18553043-5223-4221-b416-6a43365d7da4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:05 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:05 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:05 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.606s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:05 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Deleted volume successfully. Jul 07 09:32:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-04b25509-e307-4ae1-9280-8804914931d1 tempest-ProjectReaderTests-1676441012 None] Lock "cinder-5f9877e7-9281-4d93-a209-59f2652a8cb2-delete_volume" released by "delete_volume" :: held 2.159s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (c2d504a5-a743-436a-a401-3b78dc1dca44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16801952-04b1-415b-84d0-6b89cc4fd7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16801952-04b1-415b-84d0-6b89cc4fd7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409793184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d73ed53-475d-4cbb-b700-255d860607e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:06Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a718dd2-78d7-41ba-9a10-d505d6d7ca5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a718dd2-78d7-41ba-9a10-d505d6d7ca5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90927a90-fe3a-4e4c-8da8-a53bc2016f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90927a90-fe3a-4e4c-8da8-a53bc2016f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d73ed53-475d-4cbb-b700-255d860607e0', 'volume_name': 'volume-7d73ed53-475d-4cbb-b700-255d860607e0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427b276c-af12-434d-8e83-868fd217f646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427b276c-af12-434d-8e83-868fd217f646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e84e29-bb0e-4896-b020-6a7694488204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:06 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Volume 7d73ed53-475d-4cbb-b700-255d860607e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d73ed53-475d-4cbb-b700-255d860607e0', 'volume_size': 1} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-409793184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d73ed53-475d-4cbb-b700-255d860607e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:06Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Creating volume 7d73ed53-475d-4cbb-b700-255d860607e0 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:32:06 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:32:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:06 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 1073741824 Jul 07 09:32:06 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:07 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 1073741824" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:07 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 Jul 07 09:32:07 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:07 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0" returned: 0 in 0.630s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70e84e29-bb0e-4896-b020-6a7694488204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d73ed53-475d-4cbb-b700-255d860607e0', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41098254-b89e-4629-9387-d5b477089215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:07 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Volume volume-7d73ed53-475d-4cbb-b700-255d860607e0 (7d73ed53-475d-4cbb-b700-255d860607e0): created successfully Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41098254-b89e-4629-9387-d5b477089215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:07 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (c2d504a5-a743-436a-a401-3b78dc1dca44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fccac28e-29e4-4efe-9d1c-1db4792884cf tempest-ProjectReaderTests-1676441012 None] Created volume successfully. Jul 07 09:32:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-7d73ed53-475d-4cbb-b700-255d860607e0-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Lock "cinder-7d73ed53-475d-4cbb-b700-255d860607e0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-quobyte-7d73ed53-475d-4cbb-b700-255d860607e0" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-7d73ed53-475d-4cbb-b700-255d860607e0" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0905f024-9390-46d7-a7df-ee6468651661]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:08 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 Jul 07 09:32:08 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:09 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0" returned: 0 in 0.749s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:09 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0 Jul 07 09:32:09 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:09 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7d73ed53-475d-4cbb-b700-255d860607e0" returned: 0 in 0.635s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-7d73ed53-475d-4cbb-b700-255d860607e0" released by "delete_volume" :: held 1.426s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Created reservations ['0e7ac94a-ddd2-48ab-a771-444614b2e0eb', '93ebb551-f7e2-46cb-80e4-6118a8acf3c0', '7c00497d-d5bc-4f20-92e1-4e9def39255c', '4a1f8fc4-8b08-4a8f-8cc8-61ee7f32d3b8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:09 devstack sudo[105959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:09 devstack sudo[105959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:10 devstack sudo[105959]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.653s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:10 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Deleted volume successfully. Jul 07 09:32:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-53593725-a3a9-433f-aa19-37be06f8d3ab tempest-ProjectReaderTests-1676441012 None] Lock "cinder-7d73ed53-475d-4cbb-b700-255d860607e0-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:10 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:32:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (710b0845-5d30-4f41-87a4-64a9477c70d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a679fcc6-322c-48f1-8323-c4f11757e034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a679fcc6-322c-48f1-8323-c4f11757e034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522585647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd1f0e7-1a84-4894-aee9-ca93bc0f1340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:11Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f415b330-f7fa-4c6b-afe4-68ac64452ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f415b330-f7fa-4c6b-afe4-68ac64452ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef24ad82-826d-47ed-b537-8bfc9e89d34f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef24ad82-826d-47ed-b537-8bfc9e89d34f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd1f0e7-1a84-4894-aee9-ca93bc0f1340', 'volume_name': 'volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43255516-9bf9-45fd-9c86-a39b4570c1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43255516-9bf9-45fd-9c86-a39b4570c1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f629b9-9fcb-423d-877c-4962d6da5896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Volume 6bd1f0e7-1a84-4894-aee9-ca93bc0f1340: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340', 'volume_size': 1} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522585647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd1f0e7-1a84-4894-aee9-ca93bc0f1340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='107bac6bbebb40cca6c490943f10b99e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:11Z,use_quota=True,user_id='fd528f250d2a44d4b0ddc0bfa058f42d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Creating volume 6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:32:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:11 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 1073741824 Jul 07 09:32:11 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:11 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 1073741824" returned: 0 in 0.791s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:11 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 Jul 07 09:32:11 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:12 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340" returned: 0 in 0.626s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] <== create_volume: return (1456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7f629b9-9fcb-423d-877c-4962d6da5896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb52093-6cbb-4474-abde-38be1a031407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Volume volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 (6bd1f0e7-1a84-4894-aee9-ca93bc0f1340): created successfully Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efb52093-6cbb-4474-abde-38be1a031407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Flow 'volume_create_manager' (710b0845-5d30-4f41-87a4-64a9477c70d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a9e00718-d2af-4df3-ab7e-0b8021f5474b tempest-ProjectReaderTests-1676441012 None] Created volume successfully. Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Lock "cinder-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Acquiring lock "cinder-quobyte-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b6d3fc-699e-4015-b11a-37cd6d97d72e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:13 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 Jul 07 09:32:13 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:13 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:13 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340 Jul 07 09:32:13 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:14 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340" returned: 0 in 0.627s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Lock "cinder-quobyte-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340" released by "delete_volume" :: held 1.389s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Created reservations ['1b3f37bb-02ec-42bf-8c77-8a675ac90cf7', '1611a67d-456e-4b9d-b82e-7a5b19fd4dec', 'de4e3e3f-34dc-422b-9ee9-99c07c3b2f66', '448fcc50-fd3e-473c-b8ee-6025ccd27ecf'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:14 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:14 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:15 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.630s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:15 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Deleted volume successfully. Jul 07 09:32:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3a5f54c6-126f-45a0-8da8-1165731cf00d tempest-ProjectReaderTests-1676441012 None] Lock "cinder-6bd1f0e7-1a84-4894-aee9-ca93bc0f1340-delete_volume" released by "delete_volume" :: held 2.203s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:24 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=27,cinder:UPDATE=48,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:32:25 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=40,cinder:SELECT=29,cinder:INSERT=11,cinder:DELETE=6 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:26 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:26 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:27 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.649s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:32:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:32:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Flow 'volume_create_manager' (3c90b9be-a7e0-4fe1-bfd3-00f519901e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf31fc0-a181-43a4-b1fd-fa3b49307d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdf31fc0-a181-43a4-b1fd-fa3b49307d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-680241090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0870c09b-a340-4359-96f5-01a409f7df96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf62e01103445683873180912130c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:35Z,use_quota=True,user_id='f42b5d39cc614751a6030077e76362eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee40f384-c722-479d-b916-c5f869a2dc47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee40f384-c722-479d-b916-c5f869a2dc47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907378bb-5400-489f-8921-f1b437091bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907378bb-5400-489f-8921-f1b437091bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0870c09b-a340-4359-96f5-01a409f7df96', 'volume_name': 'volume-0870c09b-a340-4359-96f5-01a409f7df96', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd78099-64c8-416e-946e-e74073bb03e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cd78099-64c8-416e-946e-e74073bb03e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875f6f4d-9dea-47fc-ad32-4915d1fa04a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Volume 0870c09b-a340-4359-96f5-01a409f7df96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0870c09b-a340-4359-96f5-01a409f7df96', 'volume_size': 1} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-680241090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0870c09b-a340-4359-96f5-01a409f7df96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf62e01103445683873180912130c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:35Z,use_quota=True,user_id='f42b5d39cc614751a6030077e76362eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Creating volume 0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:32:35 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:32:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:35 devstack sudo[105987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 1073741824 Jul 07 09:32:35 devstack sudo[105987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:36 devstack sudo[105987]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 1073741824" returned: 0 in 0.816s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:36 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:36 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:36 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.624s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875f6f4d-9dea-47fc-ad32-4915d1fa04a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0870c09b-a340-4359-96f5-01a409f7df96', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e3b0c-08c2-47ac-9fb6-d9c2337ef2f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:36 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Volume volume-0870c09b-a340-4359-96f5-01a409f7df96 (0870c09b-a340-4359-96f5-01a409f7df96): created successfully Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (491e3b0c-08c2-47ac-9fb6-d9c2337ef2f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Flow 'volume_create_manager' (3c90b9be-a7e0-4fe1-bfd3-00f519901e0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6183621d-8147-41d4-be48-9744a415e940 tempest-SnapshotDependencyTests-2130523210 None] Created volume successfully. Jul 07 09:32:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Creating offline snapshot b8a6b6eb-e297-459f-92c1-3c1691c2cb61 of volume 0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:32:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[60494539-0cfa-43d1-b3c2-0685af263730]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:37 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:37 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:38 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.731s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:38 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 1G Jul 07 09:32:38 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:38 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 1G" returned: 0 in 0.755s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0870c09b-a340-4359-96f5-01a409f7df96 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:38 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0870c09b-a340-4359-96f5-01a409f7df96 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 Jul 07 09:32:38 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:39 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0870c09b-a340-4359-96f5-01a409f7df96 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61" returned: 0 in 0.684s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:39 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 is being set with open permissions: ugo+rw Jul 07 09:32:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:39 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 Jul 07 09:32:39 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:40 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61" returned: 0 in 0.615s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:40 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info Jul 07 09:32:40 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:40 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:40 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info is being set with open permissions: ugo+rw Jul 07 09:32:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:40 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info Jul 07 09:32:40 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:41 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.info" returned: 0 in 0.648s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.158s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3d99aec4-5486-4630-adf2-df51eb50b88f tempest-SnapshotDependencyTests-2130523210 None] Create snapshot completed successfully Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Flow 'volume_create_manager' (7dac576c-ace6-4946-9d05-ddb56adcfca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaaebb4-0a39-40ef-bcdb-c0d0d5d0cc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eaaebb4-0a39-40ef-bcdb-c0d0d5d0cc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=295199bd-09e9-43a9-b72a-1683387eda04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3bf62e01103445683873180912130c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b8a6b6eb-e297-459f-92c1-3c1691c2cb61,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:32:43Z,use_quota=True,user_id='f42b5d39cc614751a6030077e76362eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d398e12c-04ea-4f1c-91a0-96b67593a48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d398e12c-04ea-4f1c-91a0-96b67593a48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdcf1c4f-f3cd-474c-895d-7a22b45cb479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdcf1c4f-f3cd-474c-895d-7a22b45cb479) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '295199bd-09e9-43a9-b72a-1683387eda04', 'volume_name': 'volume-295199bd-09e9-43a9-b72a-1683387eda04', 'volume_size': 1, 'snapshot_id': 'b8a6b6eb-e297-459f-92c1-3c1691c2cb61'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0975383-e82d-4664-961e-07159048886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0975383-e82d-4664-961e-07159048886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb023f-cf23-490b-a0be-b950c2ca4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:43 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Volume 295199bd-09e9-43a9-b72a-1683387eda04: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-295199bd-09e9-43a9-b72a-1683387eda04', 'volume_size': 1, 'snapshot_id': 'b8a6b6eb-e297-459f-92c1-3c1691c2cb61'} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-quobyte-b8a6b6eb-e297-459f-92c1-3c1691c2cb61-295199bd-09e9-43a9-b72a-1683387eda04" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-b8a6b6eb-e297-459f-92c1-3c1691c2cb61-295199bd-09e9-43a9-b72a-1683387eda04" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Creating volume 295199bd-09e9-43a9-b72a-1683387eda04 from snapshot b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-quobyte-295199bd-09e9-43a9-b72a-1683387eda04" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-295199bd-09e9-43a9-b72a-1683387eda04" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] snapshot: b8a6b6eb-e297-459f-92c1-3c1691c2cb61, volume: 295199bd-09e9-43a9-b72a-1683387eda04, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6987274-ea42-4d69-bdeb-40166e935d9d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:43 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 Jul 07 09:32:43 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:44 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0870c09b-a340-4359-96f5-01a409f7df96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc30416-e5af-4f98-980b-4387c6fced15]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:44 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:44 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:44 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:32:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:44 devstack sudo[106068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 Jul 07 09:32:44 devstack sudo[106068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:49 devstack sudo[106068]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04" returned: 0 in 4.335s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:49 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[769660b0-639a-4fce-a87b-e813cc2a4785]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:49 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:49 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:50 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.917s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96, size 1024.00 MB, duration 4.34 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:32:50 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Converted 1024.00 MB image at 236.15 MB/s Jul 07 09:32:50 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 is being set with open permissions: ugo+rw Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:50 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 Jul 07 09:32:50 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:50 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04" returned: 0 in 0.624s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-295199bd-09e9-43a9-b72a-1683387eda04" released by "_copy_volume_from_snapshot" :: held 7.479s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-b8a6b6eb-e297-459f-92c1-3c1691c2cb61-295199bd-09e9-43a9-b72a-1683387eda04" released by "_create_volume_from_snapshot" :: held 7.509s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.524s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05bb023f-cf23-490b-a0be-b950c2ca4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-295199bd-09e9-43a9-b72a-1683387eda04', 'volume_size': 1, 'snapshot_id': 'b8a6b6eb-e297-459f-92c1-3c1691c2cb61'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88627524-5bb8-48a6-a07c-20adf72ae647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:32:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Volume volume-295199bd-09e9-43a9-b72a-1683387eda04 (295199bd-09e9-43a9-b72a-1683387eda04): created successfully Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88627524-5bb8-48a6-a07c-20adf72ae647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:32:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Flow 'volume_create_manager' (7dac576c-ace6-4946-9d05-ddb56adcfca4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:32:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-33dd40a4-78f9-4034-93f3-98757bc3f1fc tempest-SnapshotDependencyTests-2130523210 None] Created volume successfully. Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-b8a6b6eb-e297-459f-92c1-3c1691c2cb61-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-b8a6b6eb-e297-459f-92c1-3c1691c2cb61-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-quobyte-0870c09b-a340-4359-96f5-01a409f7df96" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-0870c09b-a340-4359-96f5-01a409f7df96" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-quobyte-b8a6b6eb-e297-459f-92c1-3c1691c2cb61" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-b8a6b6eb-e297-459f-92c1-3c1691c2cb61" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Deleting offline snapshot b8a6b6eb-e297-459f-92c1-3c1691c2cb61 of volume 0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] snapshot_file for this snap is: volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01b4cd4-5a2a-4ace-8b26-f45ab95a05ad]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:52 devstack sudo[106097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 Jul 07 09:32:52 devstack sudo[106097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:52 devstack sudo[106097]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61" returned: 0 in 0.748s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0870c09b-a340-4359-96f5-01a409f7df96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:32:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[165ab9df-a3e3-48cf-941d-d96f62ec74ec]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:52 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:52 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:53 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.772s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:53 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 Jul 07 09:32:53 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:54 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:54 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61 Jul 07 09:32:54 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:54 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96.b8a6b6eb-e297-459f-92c1-3c1691c2cb61" returned: 0 in 0.617s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-b8a6b6eb-e297-459f-92c1-3c1691c2cb61" released by "_delete_snapshot" :: held 2.956s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-0870c09b-a340-4359-96f5-01a409f7df96" released by "delete_snapshot" :: held 2.977s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Created reservations ['1283b1d3-f864-490f-8132-a0a95325e088', '39222dd4-0474-4228-9c62-fd528e408c90', 'a51c1161-4a9e-4fb9-827c-83b21d307635', 'e75c1cb6-a289-4008-841f-5139202d6962'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Delete snapshot completed successfully. Jul 07 09:32:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-e9bddb54-d7dc-4ee2-ba42-2419667d111b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-b8a6b6eb-e297-459f-92c1-3c1691c2cb61-delete_snapshot" released by "delete_snapshot" :: held 3.110s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-0870c09b-a340-4359-96f5-01a409f7df96-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-0870c09b-a340-4359-96f5-01a409f7df96-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-quobyte-0870c09b-a340-4359-96f5-01a409f7df96" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-0870c09b-a340-4359-96f5-01a409f7df96" acquired by "delete_volume" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[288113b4-397b-4dc5-a79a-7bef985b0a5b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:55 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:55 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:55 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.739s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:55 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96 Jul 07 09:32:55 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:56 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0870c09b-a340-4359-96f5-01a409f7df96" returned: 0 in 0.623s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-0870c09b-a340-4359-96f5-01a409f7df96" released by "delete_volume" :: held 1.416s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Created reservations ['59895e21-f92e-4d08-a3ad-82896194e34d', 'b23aad37-7888-4c81-9e8b-6b34960949b7', 'f2f13a89-2455-4d91-ad53-e76e7737df8e', '750f3f18-f0a7-424c-bbe7-8f198e496d04'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:56 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:56 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:57 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.625s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-295199bd-09e9-43a9-b72a-1683387eda04-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Deleted volume successfully. Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-295199bd-09e9-43a9-b72a-1683387eda04-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9ba15f5-3faf-445b-802b-84d62ee7f02a tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-0870c09b-a340-4359-96f5-01a409f7df96-delete_volume" released by "delete_volume" :: held 2.230s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "cinder-quobyte-295199bd-09e9-43a9-b72a-1683387eda04" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-295199bd-09e9-43a9-b72a-1683387eda04" acquired by "delete_volume" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c65d6d7-e2a7-4a41-b778-b2d28f4c6a4a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:32:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:57 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 Jul 07 09:32:57 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:58 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04" returned: 0 in 0.719s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:58 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04 Jul 07 09:32:58 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:58 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-295199bd-09e9-43a9-b72a-1683387eda04" returned: 0 in 0.634s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-quobyte-295199bd-09e9-43a9-b72a-1683387eda04" released by "delete_volume" :: held 1.388s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Created reservations ['0ed4d81e-4d5f-49d8-9cf5-4a2295f2a63c', '53b7152f-96b0-453b-8540-3d0eea315e47', 'aed2ba0e-14e5-454e-9248-f757f8765918', '9bb7a37a-c6a7-46a8-bfe4-d1c21cdd291b'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:32:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:32:58 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:32:58 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:32:59 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 07 09:32:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.622s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:32:59 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:32:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Deleted volume successfully. Jul 07 09:32:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-0f69d3ed-e834-41d3-a4c6-a749ffdde06b tempest-SnapshotDependencyTests-2130523210 None] Lock "cinder-295199bd-09e9-43a9-b72a-1683387eda04-delete_volume" released by "delete_volume" :: held 2.190s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:08 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:33:09 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=28,cinder:SELECT=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (cf7591b2-d7fe-4675-9799-c6d174401c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfa0292-3c85-4137-92d7-d062adfca097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cfa0292-3c85-4137-92d7-d062adfca097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387857245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a501f99-9d1e-4b84-8326-3a07ea7d626b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:18Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6533692f-7a15-4257-9749-9136283566cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6533692f-7a15-4257-9749-9136283566cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24de3a4a-621e-46c3-bfd8-bd01f03d2d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24de3a4a-621e-46c3-bfd8-bd01f03d2d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a501f99-9d1e-4b84-8326-3a07ea7d626b', 'volume_name': 'volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0daa6941-c47d-4346-9e2c-842530a69624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0daa6941-c47d-4346-9e2c-842530a69624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a61667-52c9-4592-956b-434764eb4870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Volume 0a501f99-9d1e-4b84-8326-3a07ea7d626b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b', 'volume_size': 1} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1387857245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a501f99-9d1e-4b84-8326-3a07ea7d626b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:18Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Creating volume 0a501f99-9d1e-4b84-8326-3a07ea7d626b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:18 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:18 devstack sudo[106185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b 1073741824 Jul 07 09:33:18 devstack sudo[106185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (d42e3512-d13e-4229-95b2-c1ee6eeef553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239aabff-a921-4308-8598-4cf137ba79e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (239aabff-a921-4308-8598-4cf137ba79e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603352513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afea2f69-ed6c-41b2-a084-ec90a74228e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:19Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7741162-1cad-4840-9a66-ffdc90b5a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7741162-1cad-4840-9a66-ffdc90b5a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d821d08-e2bd-41f4-b825-3be01bf37cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d821d08-e2bd-41f4-b825-3be01bf37cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afea2f69-ed6c-41b2-a084-ec90a74228e9', 'volume_name': 'volume-afea2f69-ed6c-41b2-a084-ec90a74228e9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad40908-f045-42c2-a13a-83d2c914c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ad40908-f045-42c2-a13a-83d2c914c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a0b985-4147-48b3-a49f-e6fd172dbeec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume afea2f69-ed6c-41b2-a084-ec90a74228e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afea2f69-ed6c-41b2-a084-ec90a74228e9', 'volume_size': 1} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (9c379fbd-52b4-4be5-9342-06d10bbbe553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f2d5f-1959-401d-ab39-62a29234e841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (29c6cd7b-1dc4-438e-b6bc-9bc36d9f2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae83e84e-8582-4521-b82d-f834a4ea1428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1f2d5f-1959-401d-ab39-62a29234e841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1556157160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d60b34-fa42-4a41-adac-00617011cd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:19Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb229b82-afdb-42b7-94da-e9debfe805c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb229b82-afdb-42b7-94da-e9debfe805c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8e471b-158c-42dc-8da5-0698606cc76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b8e471b-158c-42dc-8da5-0698606cc76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01d60b34-fa42-4a41-adac-00617011cd45', 'volume_name': 'volume-01d60b34-fa42-4a41-adac-00617011cd45', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c5939b-8316-4774-88ad-8d5c7048991f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c5939b-8316-4774-88ad-8d5c7048991f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5105f4-da6b-4b49-bae4-494c119a795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Volume 01d60b34-fa42-4a41-adac-00617011cd45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01d60b34-fa42-4a41-adac-00617011cd45', 'volume_size': 1} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae83e84e-8582-4521-b82d-f834a4ea1428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1909184049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3906098c-c3e3-483f-8aae-158578083fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:20Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939b75af-1e8b-42ff-a367-578763777e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (939b75af-1e8b-42ff-a367-578763777e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150bb8be-8b06-4273-b65e-369ca38f8c47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150bb8be-8b06-4273-b65e-369ca38f8c47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3906098c-c3e3-483f-8aae-158578083fe6', 'volume_name': 'volume-3906098c-c3e3-483f-8aae-158578083fe6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe7b267-895b-4b27-9e99-798e720c4a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfe7b267-895b-4b27-9e99-798e720c4a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31488114-5507-4d51-916d-a0c41adb4d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Volume 3906098c-c3e3-483f-8aae-158578083fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3906098c-c3e3-483f-8aae-158578083fe6', 'volume_size': 1} Jul 07 09:33:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:20 devstack sudo[106185]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (2b57c68d-d816-4785-8ad5-5f6f4edccd23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7133515-e6c6-4547-b463-47a04353d8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b 1073741824" returned: 0 in 1.415s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7133515-e6c6-4547-b463-47a04353d8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333593893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5f9add-d7d8-4ad1-b423-a11fcf98de87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:20Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f205d04-cf64-48c2-8570-9705e703409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f205d04-cf64-48c2-8570-9705e703409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b0719a-9b47-4e25-a8c4-df962752f960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92b0719a-9b47-4e25-a8c4-df962752f960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5f9add-d7d8-4ad1-b423-a11fcf98de87', 'volume_name': 'volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff66d2f1-3387-469d-a439-33a7289434c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff66d2f1-3387-469d-a439-33a7289434c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0678d1e-84dc-4af4-89d9-10bb5a78ce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Volume 8d5f9add-d7d8-4ad1-b423-a11fcf98de87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87', 'volume_size': 1} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:20 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b Jul 07 09:33:20 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (26dae58d-d040-4409-8ba1-76f2aef1808d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93006e69-a21f-4b21-8c0a-f0833926be5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93006e69-a21f-4b21-8c0a-f0833926be5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1498365480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2240b02b-d2dd-41e2-9212-349ef13e0827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:20Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c4f1ce-b2f3-457a-9fb4-260dddf9db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10c4f1ce-b2f3-457a-9fb4-260dddf9db82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20dcdcb-c6f0-482c-a4c7-a8c51d4ddff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d20dcdcb-c6f0-482c-a4c7-a8c51d4ddff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2240b02b-d2dd-41e2-9212-349ef13e0827', 'volume_name': 'volume-2240b02b-d2dd-41e2-9212-349ef13e0827', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6e3c66-af6c-40a7-821f-3abe8dde562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a6e3c66-af6c-40a7-821f-3abe8dde562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b7ac4d-f39f-4a35-b425-e39a9edc4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Volume 2240b02b-d2dd-41e2-9212-349ef13e0827: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2240b02b-d2dd-41e2-9212-349ef13e0827', 'volume_size': 1} Jul 07 09:33:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:20 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b" returned: 0 in 0.815s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1603352513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afea2f69-ed6c-41b2-a084-ec90a74228e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:19Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating volume afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:21 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4a61667-52c9-4592-956b-434764eb4870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:21 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 1073741824 Jul 07 09:33:21 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec83dc7-65aa-41cc-9882-7ac896a877f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:21 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Volume volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b (0a501f99-9d1e-4b84-8326-3a07ea7d626b): created successfully Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ec83dc7-65aa-41cc-9882-7ac896a877f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (cf7591b2-d7fe-4675-9799-c6d174401c7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e0ec03b6-475b-4010-acf9-686740c7bc31 tempest-CreateVolumesFromImageTest-1294226668 None] Created volume successfully. Jul 07 09:33:21 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 1073741824" returned: 0 in 0.956s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Flow 'volume_create_manager' (b39886d7-22ee-4695-bead-8e9e84812a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494f4602-13d1-45ec-98fc-31d0ae82ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:22 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (494f4602-13d1-45ec-98fc-31d0ae82ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172958b3-bdbf-4716-842f-0021f8d4f1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12da94d798a48ec9500145bbf3e51a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:22Z,use_quota=True,user_id='45a02983329546bea63dc2b200ed9159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:22 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a61dcb-1735-45c9-b89f-8240f6e03f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6a61dcb-1735-45c9-b89f-8240f6e03f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f95e54-8b7f-4791-b3a2-ea3eed23d804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f95e54-8b7f-4791-b3a2-ea3eed23d804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '172958b3-bdbf-4716-842f-0021f8d4f1b3', 'volume_name': 'volume-172958b3-bdbf-4716-842f-0021f8d4f1b3', 'volume_size': 1, 'image_id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6fbc888-bc20-4045-b8a6-e772edb21888', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '907bf850ea5993d62717dd93e26eac8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a12da94d798a48ec9500145bbf3e51a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3dfdd6bae443d40d30bf81b80f7b4e92b53a0851f9d77000272dab633f7ef56241f7edbd79f07dc0b6c6bb38a2b4f7511b64f71c7e90f24cea24fa86fc00b372', 'id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'created_at': datetime.datetime(2026, 7, 7, 7, 33, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 33, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6fbc888-bc20-4045-b8a6-e772edb21888/file', 'properties': {}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bced14a-fe56-4c0e-bc49-26653a2a0ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bced14a-fe56-4c0e-bc49-26653a2a0ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91a3d46-0ca7-4e78-9911-a6b7e153cc67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:22 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Volume 172958b3-bdbf-4716-842f-0021f8d4f1b3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-172958b3-bdbf-4716-842f-0021f8d4f1b3', 'volume_size': 1, 'image_id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6fbc888-bc20-4045-b8a6-e772edb21888', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '907bf850ea5993d62717dd93e26eac8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a12da94d798a48ec9500145bbf3e51a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3dfdd6bae443d40d30bf81b80f7b4e92b53a0851f9d77000272dab633f7ef56241f7edbd79f07dc0b6c6bb38a2b4f7511b64f71c7e90f24cea24fa86fc00b372', 'id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'created_at': datetime.datetime(2026, 7, 7, 7, 33, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 33, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6fbc888-bc20-4045-b8a6-e772edb21888/file', 'properties': {}}, 'image_service': } Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Trying to clone 172958b3-bdbf-4716-842f-0021f8d4f1b3 from image c6fbc888-bc20-4045-b8a6-e772edb21888 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c6fbc888-bc20-4045-b8a6-e772edb21888', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:33:22 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Image download 0.00 MB at 0.00 MB/s Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74ac397-af7a-4332-a938-aa1714812b98]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:22 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD Jul 07 09:33:22 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:22 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.858s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1556157160',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01d60b34-fa42-4a41-adac-00617011cd45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:19Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Creating volume 01d60b34-fa42-4a41-adac-00617011cd45 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:22 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:22 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 1073741824 Jul 07 09:33:22 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18a0b985-4147-48b3-a49f-e6fd172dbeec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afea2f69-ed6c-41b2-a084-ec90a74228e9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc371b4-650b-470c-a183-84f77c326885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:22 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 (afea2f69-ed6c-41b2-a084-ec90a74228e9): created successfully Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cc371b4-650b-470c-a183-84f77c326885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:22 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (d42e3512-d13e-4229-95b2-c1ee6eeef553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-926a23b7-433d-46ea-a3cb-2bd24dd3c484 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created volume successfully. Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Flow 'volume_create_manager' (04f324b9-5a09-40c0-9453-01fbda802e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0202e2c-8e6e-4e73-96d6-7349c7cc84b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0202e2c-8e6e-4e73-96d6-7349c7cc84b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1780f5-5d0d-4780-a627-70d949b0d7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611603c52e96485da58a66af8c89336f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:23Z,use_quota=True,user_id='74181e495b7a40959cfbb539741c574b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e1a892-4fef-47c0-b540-043c3514eb5e),volume_type_id=d7e1a892-4fef-47c0-b540-043c3514eb5e)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9c16e4-e8c0-400f-a810-60ec39d264a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b9c16e4-e8c0-400f-a810-60ec39d264a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea241999-83f5-4225-b261-b57faf177be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.image.glance [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Creating Keystone auth plugin from conf {{(pid=86769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:23 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD" returned: 0 in 0.944s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea241999-83f5-4225-b261-b57faf177be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8c1780f5-5d0d-4780-a627-70d949b0d7ef', 'volume_name': 'volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef', 'volume_size': 1, 'image_id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8e5ea25-efbc-44d9-9822-230b47d1609b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea814fe0209e0a19efe3ae499221cc26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '611603c52e96485da58a66af8c89336f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21b829e9ed2c159e446b7761b5728cf41e458b3793c9b89144b77e6f5af46853f859ea43cc0a30d151e5f0baf451ca6d7e0f983bae7ca86b311f55227532384b', 'id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'created_at': datetime.datetime(2026, 7, 7, 7, 33, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8e5ea25-efbc-44d9-9822-230b47d1609b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e4fc7a-e58f-4439-85c0-56897e9a188c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58e4fc7a-e58f-4439-85c0-56897e9a188c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e056bb-ea4a-4b6e-b2da-47c3b6defbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:23 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Volume 8c1780f5-5d0d-4780-a627-70d949b0d7ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef', 'volume_size': 1, 'image_id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8e5ea25-efbc-44d9-9822-230b47d1609b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea814fe0209e0a19efe3ae499221cc26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '611603c52e96485da58a66af8c89336f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21b829e9ed2c159e446b7761b5728cf41e458b3793c9b89144b77e6f5af46853f859ea43cc0a30d151e5f0baf451ca6d7e0f983bae7ca86b311f55227532384b', 'id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'created_at': datetime.datetime(2026, 7, 7, 7, 33, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8e5ea25-efbc-44d9-9822-230b47d1609b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Trying to clone 8c1780f5-5d0d-4780-a627-70d949b0d7ef from image e8e5ea25-efbc-44d9-9822-230b47d1609b at location (None, [{'url': 'file:///opt/stack/data/glance/images/e8e5ea25-efbc-44d9-9822-230b47d1609b', 'metadata': {}}]). {{(pid=86769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 07 09:33:23 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD Jul 07 09:33:23 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 07 09:33:23 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Image download 0.00 MB at 0.00 MB/s Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc26af15-fc42-4509-b04a-fd0f753599cc]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:23 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 1073741824" returned: 0 in 1.075s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:23 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 Jul 07 09:33:23 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:23 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD Jul 07 09:33:23 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:24 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD" returned: 1 in 0.772s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Temporary image c6fbc888-bc20-4045-b8a6-e772edb21888 is fetched for user 45a02983329546bea63dc2b200ed9159. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[06282cc0-1757-4fb7-a283-e9b8ad432b4c]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:24 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD Jul 07 09:33:24 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:24 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45" returned: 0 in 0.691s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:24 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.816s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.598s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1909184049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3906098c-c3e3-483f-8aae-158578083fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:20Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Creating volume 3906098c-c3e3-483f-8aae-158578083fe6 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:24 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD" returned: 0 in 0.806s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:24 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 1073741824 Jul 07 09:33:24 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a5105f4-da6b-4b49-bae4-494c119a795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01d60b34-fa42-4a41-adac-00617011cd45', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f456f77b-a9d6-4f92-9987-6389cd0f69fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:24 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Volume volume-01d60b34-fa42-4a41-adac-00617011cd45 (01d60b34-fa42-4a41-adac-00617011cd45): created successfully Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f456f77b-a9d6-4f92-9987-6389cd0f69fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (9c379fbd-52b4-4be5-9342-06d10bbbe553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0a304723-d822-4cbf-ab6b-d7677d97a4ed tempest-CreateVolumesFromImageTest-1294226668 None] Created volume successfully. Jul 07 09:33:24 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD Jul 07 09:33:24 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:25 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:25 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD Jul 07 09:33:25 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:25 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD" returned: 1 in 0.787s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Temporary image e8e5ea25-efbc-44d9-9822-230b47d1609b is fetched for user 74181e495b7a40959cfbb539741c574b. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 07 09:33:25 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 1073741824" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c62b111-ebde-4119-962d-6d8b646245a2]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:25 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 Jul 07 09:33:25 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:25 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD Jul 07 09:33:25 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:25 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD" returned: 1 in 0.819s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:26 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6" returned: 0 in 0.681s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1333593893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5f9add-d7d8-4ad1-b423-a11fcf98de87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:20Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Creating volume 8d5f9add-d7d8-4ad1-b423-a11fcf98de87 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:26 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:26 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 1073741824 Jul 07 09:33:26 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31488114-5507-4d51-916d-a0c41adb4d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3906098c-c3e3-483f-8aae-158578083fe6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:26 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1186a2df-468d-41dd-a6e6-3e57d0011f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:26 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Volume volume-3906098c-c3e3-483f-8aae-158578083fe6 (3906098c-c3e3-483f-8aae-158578083fe6): created successfully Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1186a2df-468d-41dd-a6e6-3e57d0011f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (29c6cd7b-1dc4-438e-b6bc-9bc36d9f2c72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fe84345c-4ca9-442c-9495-0e1947ce5b70 tempest-CreateVolumesFromImageTest-1294226668 None] Created volume successfully. Jul 07 09:33:26 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD Jul 07 09:33:26 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:26 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:26 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:27 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:27 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 1073741824" returned: 0 in 0.877s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:27 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 Jul 07 09:33:27 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:27 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.650s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:33:27 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87" returned: 0 in 0.686s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] <== create_volume: return (1604ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.203s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1498365480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2240b02b-d2dd-41e2-9212-349ef13e0827,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b3d7e265c204bcea193fc8d0093a1c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:20Z,use_quota=True,user_id='f0a241b7052f43388e36d684aba211b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Creating volume 2240b02b-d2dd-41e2-9212-349ef13e0827 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:27 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:27 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 1073741824 Jul 07 09:33:27 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0678d1e-84dc-4af4-89d9-10bb5a78ce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794b7b2c-bdfe-4b9d-84b2-290d33c158bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:27 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Volume volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 (8d5f9add-d7d8-4ad1-b423-a11fcf98de87): created successfully Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (794b7b2c-bdfe-4b9d-84b2-290d33c158bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (2b57c68d-d816-4785-8ad5-5f6f4edccd23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-0fe3c3ef-1365-4c36-a0ef-568a41a07e91 tempest-CreateVolumesFromImageTest-1294226668 None] Created volume successfully. Jul 07 09:33:28 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 1073741824" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:28 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 Jul 07 09:33:28 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:29 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827" returned: 0 in 0.626s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.847s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b7ac4d-f39f-4a35-b425-e39a9edc4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2240b02b-d2dd-41e2-9212-349ef13e0827', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdb0181-6d23-41df-8b0b-c79604bb72ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating offline snapshot 4479a8e9-4ebb-451c-90e1-79b3d0720690 of volume afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:33:29 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Volume volume-2240b02b-d2dd-41e2-9212-349ef13e0827 (2240b02b-d2dd-41e2-9212-349ef13e0827): created successfully Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcdb0181-6d23-41df-8b0b-c79604bb72ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Flow 'volume_create_manager' (26dae58d-d040-4409-8ba1-76f2aef1808d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cdfaa4-7386-48c7-b39d-86738ffa2583]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-33effe8e-cc37-4eaa-99d9-a7e754e6ed48 tempest-CreateVolumesFromImageTest-1294226668 None] Created volume successfully. Jul 07 09:33:29 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 Jul 07 09:33:29 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:30 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9" returned: 0 in 0.765s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:30 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 1G Jul 07 09:33:30 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-2240b02b-d2dd-41e2-9212-349ef13e0827-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-2240b02b-d2dd-41e2-9212-349ef13e0827-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-quobyte-2240b02b-d2dd-41e2-9212-349ef13e0827" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-2240b02b-d2dd-41e2-9212-349ef13e0827" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecd235c-1179-4100-8b98-1c32de3c751f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:30 devstack sudo[106287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 Jul 07 09:33:30 devstack sudo[106287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:30 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 1G" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:30 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 Jul 07 09:33:30 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:31 devstack sudo[106287]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:31 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827 Jul 07 09:33:31 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:31 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690" returned: 0 in 0.671s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:31 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 is being set with open permissions: ugo+rw Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:31 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 Jul 07 09:33:31 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:31 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2240b02b-d2dd-41e2-9212-349ef13e0827" returned: 0 in 0.657s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-2240b02b-d2dd-41e2-9212-349ef13e0827" released by "delete_volume" :: held 1.463s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Created reservations ['a94ad1d0-fea0-41b2-bb35-7e5800260e92', '5e95d4a5-e47f-4b08-810c-b87510b5a1d1', '831e26be-f77f-47b8-a166-a5bff4dd2051', 'e827ce1a-a737-4fbb-b751-0290b582133b'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:31 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:31 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:32 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690" returned: 0 in 0.651s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:32 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info Jul 07 09:33:32 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-8d5f9add-d7d8-4ad1-b423-a11fcf98de87-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-8d5f9add-d7d8-4ad1-b423-a11fcf98de87-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-quobyte-8d5f9add-d7d8-4ad1-b423-a11fcf98de87" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-8d5f9add-d7d8-4ad1-b423-a11fcf98de87" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[30624538-a63a-42e1-9c70-1e6b84f18817]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:32 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.747s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Deleted volume successfully. Jul 07 09:33:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c69ed22a-4647-4083-b733-a22be93a756d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-2240b02b-d2dd-41e2-9212-349ef13e0827-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:32 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 Jul 07 09:33:32 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:33 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info" returned: 0 in 0.738s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:33 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info is being set with open permissions: ugo+rw Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:33 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info Jul 07 09:33:33 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:33 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87" returned: 0 in 0.775s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:33 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87 Jul 07 09:33:33 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.info" returned: 0 in 0.709s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.511s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.800s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=172958b3-bdbf-4716-842f-0021f8d4f1b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a12da94d798a48ec9500145bbf3e51a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:22Z,use_quota=True,user_id='45a02983329546bea63dc2b200ed9159',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Creating volume 172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:33 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:33 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 1073741824 Jul 07 09:33:33 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6f5eba10-46a9-4b8e-ba9e-5f7f3befd051 tempest-CreateVolumesFromSnapshotTest-104972955 None] Create snapshot completed successfully Jul 07 09:33:33 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d5f9add-d7d8-4ad1-b423-a11fcf98de87" returned: 0 in 0.652s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-8d5f9add-d7d8-4ad1-b423-a11fcf98de87" released by "delete_volume" :: held 1.472s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Created reservations ['ad54e702-3ec9-461a-b0a6-eb21c3015f6b', '35b7aa93-fd72-4047-8393-61edf9390ee1', 'b69b812d-ef34-40c4-b782-90007d84359f', 'd4ae4fed-603a-4baa-99ad-37b86f11e98c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:34 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:34 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:34 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 1073741824" returned: 0 in 0.833s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-3906098c-c3e3-483f-8aae-158578083fe6-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-3906098c-c3e3-483f-8aae-158578083fe6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:34 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:34 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-quobyte-3906098c-c3e3-483f-8aae-158578083fe6" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-3906098c-c3e3-483f-8aae-158578083fe6" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201f903-cc65-4ca0-89b6-060cd44c37d9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:34 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Deleted volume successfully. Jul 07 09:33:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-8fd0c207-d14d-4ce5-8cc8-48c0d172be54 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-8d5f9add-d7d8-4ad1-b423-a11fcf98de87-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:34 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 Jul 07 09:33:34 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (7a949a52-bc4f-44bd-a339-082bab5ed267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be66db0-35dc-4851-be59-93b7922797c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be66db0-35dc-4851-be59-93b7922797c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314968942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab79201-c23b-463d-aa24-6780ee0ffe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:35Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e68a5-0934-4d46-9278-028ced3be032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a3e68a5-0934-4d46-9278-028ced3be032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea726f4-fcad-4ddd-b6f1-e1877be9925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ea726f4-fcad-4ddd-b6f1-e1877be9925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aab79201-c23b-463d-aa24-6780ee0ffe7c', 'volume_name': 'volume-aab79201-c23b-463d-aa24-6780ee0ffe7c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e0e8e0-cc54-4c10-97b9-16feda359b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e0e8e0-cc54-4c10-97b9-16feda359b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55214fde-f80e-4f1a-942c-98bd49f4f4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume aab79201-c23b-463d-aa24-6780ee0ffe7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aab79201-c23b-463d-aa24-6780ee0ffe7c', 'volume_size': 1} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:35 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 0 in 0.874s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.532s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c1780f5-5d0d-4780-a627-70d949b0d7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='611603c52e96485da58a66af8c89336f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:23Z,use_quota=True,user_id='74181e495b7a40959cfbb539741c574b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d7e1a892-4fef-47c0-b540-043c3514eb5e),volume_type_id=d7e1a892-4fef-47c0-b540-043c3514eb5e)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Creating volume 8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:35 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:35 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef 1073741824 Jul 07 09:33:35 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Attempting download of c6fbc888-bc20-4045-b8a6-e772edb21888 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6fbc888-bc20-4045-b8a6-e772edb21888', 'metadata': {}}])) to volume 172958b3-bdbf-4716-842f-0021f8d4f1b3. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4576ecbd-863a-48a4-b97a-feffc9a5fc78]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (0be0603c-99ec-4631-9058-fc24749a58c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcab1b65-5524-4f1d-bfd5-40f1da06bb2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6" returned: 0 in 1.041s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:35 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6 Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcab1b65-5524-4f1d-bfd5-40f1da06bb2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130705591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:36Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:35 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl Jul 07 09:33:35 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c321d862-6ccc-478a-97ce-b834aabe0af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c321d862-6ccc-478a-97ce-b834aabe0af0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc0e2a2-cc67-4833-b146-b90b9968c1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc0e2a2-cc67-4833-b146-b90b9968c1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca', 'volume_name': 'volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1ffe7b-b292-4908-8483-6d17d11106b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1ffe7b-b292-4908-8483-6d17d11106b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:35 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f138a544-c00a-4170-a913-cd8788edf5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume 9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca', 'volume_size': 1} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (c162ecc6-c60b-4dc4-8509-19511d27d9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38036b2a-e709-4a42-8b87-10659f9cc829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38036b2a-e709-4a42-8b87-10659f9cc829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2137410478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2978fc97-58a1-49cb-80b0-2ad0fc26168c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:36Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7af61bc-f8a2-4e42-b4de-3ee557b3fd04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7af61bc-f8a2-4e42-b4de-3ee557b3fd04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a422eb8-9e24-4206-b61a-034cae8a8801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a422eb8-9e24-4206-b61a-034cae8a8801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2978fc97-58a1-49cb-80b0-2ad0fc26168c', 'volume_name': 'volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1121fc85-2967-42a8-9bfe-d9c591ddc48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1121fc85-2967-42a8-9bfe-d9c591ddc48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820c35c9-71a5-43b6-935b-1c0524da3633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume 2978fc97-58a1-49cb-80b0-2ad0fc26168c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c', 'volume_size': 1} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:36 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-3906098c-c3e3-483f-8aae-158578083fe6" returned: 0 in 0.854s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-3906098c-c3e3-483f-8aae-158578083fe6" released by "delete_volume" :: held 1.958s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:36 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl" returned: 0 in 1.039s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:36 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef 1073741824" returned: 0 in 1.295s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (db6be938-3861-42cf-bcae-ba2ffccd9a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135b1cf7-1e0a-4f90-a094-5eec17e2c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (135b1cf7-1e0a-4f90-a094-5eec17e2c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177495263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9283ad1b-1a7e-496d-afa8-c78fb5b69aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:37Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c48f1c-aa82-4014-a927-c50f4df3d11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c48f1c-aa82-4014-a927-c50f4df3d11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf15d7-854f-4a50-bd85-bda2cd2a74d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fbf15d7-854f-4a50-bd85-bda2cd2a74d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9283ad1b-1a7e-496d-afa8-c78fb5b69aa9', 'volume_name': 'volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e9d2b5-b91c-4184-8b6b-d7bd02d93a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl Jul 07 09:33:36 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e9d2b5-b91c-4184-8b6b-d7bd02d93a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b9efaa-035b-4812-bd5f-66adaa71e175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:36 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume 9283ad1b-1a7e-496d-afa8-c78fb5b69aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9', 'volume_size': 1} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:36 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Created reservations ['1dfa5bfa-6b07-48b4-89ca-59832a814379', 'c1f2f378-6b5e-4753-beb4-7ae25a83efca', '444ed782-6d82-4a42-8208-b04747b032ad', '194010a3-1c5a-440c-bed1-47628a5181ff'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:37 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:37 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:37 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:37 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (3da988ef-b9c1-4229-afe7-240b81730028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874e6252-6fa7-429b-815d-4055a12f9a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874e6252-6fa7-429b-815d-4055a12f9a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607443752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:37Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bbd136-0a64-4572-a89f-ae61dafa8d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62bbd136-0a64-4572-a89f-ae61dafa8d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652a3f9a-807e-490b-9937-6ebdf3c6d4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (652a3f9a-807e-490b-9937-6ebdf3c6d4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207', 'volume_name': 'volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0e5d2e-d795-478a-ae89-a496d35e1841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e0e5d2e-d795-478a-ae89-a496d35e1841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18576977-3c7a-41bc-beec-c58d665e5d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207', 'volume_size': 1} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:37 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl" returned: 1 in 0.930s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c6fbc888-bc20-4045-b8a6-e772edb21888_ufnyixkl' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0528dd6b-c059-4719-96b6-d70488a323cb]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:37 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 0 in 0.743s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.211s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.347s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314968942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aab79201-c23b-463d-aa24-6780ee0ffe7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:35Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating volume aab79201-c23b-463d-aa24-6780ee0ffe7c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:37 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:37 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.726s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:37 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c 1073741824 Jul 07 09:33:37 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Attempting download of e8e5ea25-efbc-44d9-9822-230b47d1609b ((None, [{'url': 'file:///opt/stack/data/glance/images/e8e5ea25-efbc-44d9-9822-230b47d1609b', 'metadata': {}}])) to volume 8c1780f5-5d0d-4780-a627-70d949b0d7ef. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 07 09:33:37 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Deleted volume successfully. Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-11f7b58c-16bf-44e6-ac8a-b451b0d2397d tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-3906098c-c3e3-483f-8aae-158578083fe6-delete_volume" released by "delete_volume" :: held 3.146s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:37 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD Jul 07 09:33:37 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b057f929-cf34-44d6-a955-4b5aa0b2b00c]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-01d60b34-fa42-4a41-adac-00617011cd45-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:38 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m Jul 07 09:33:38 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-01d60b34-fa42-4a41-adac-00617011cd45-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-quobyte-01d60b34-fa42-4a41-adac-00617011cd45" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-01d60b34-fa42-4a41-adac-00617011cd45" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb20a59-c5af-42d7-b3ec-7b85cb7964d5]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:38 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 Jul 07 09:33:38 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:38 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD" returned: 0 in 0.903s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:38 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c 1073741824" returned: 0 in 0.896s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:38 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c Jul 07 09:33:38 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:38 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD Jul 07 09:33:38 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:38 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m" returned: 0 in 0.900s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:38 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m Jul 07 09:33:38 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:39 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45" returned: 0 in 0.911s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:39 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45 Jul 07 09:33:39 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:39 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD" returned: 1 in 0.825s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] c6fbc888-bc20-4045-b8a6-e772edb21888 was raw, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:33:39 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c" returned: 0 in 0.757s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] <== create_volume: return (1715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.493s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1130705591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:36Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating volume 9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:39 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:39 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:39 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55214fde-f80e-4f1a-942c-98bd49f4f4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aab79201-c23b-463d-aa24-6780ee0ffe7c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:39 devstack sudo[106397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca 1073741824 Jul 07 09:33:39 devstack sudo[106397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22284ca1-41ca-4d48-b9b7-2904782c6576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:39 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume volume-aab79201-c23b-463d-aa24-6780ee0ffe7c (aab79201-c23b-463d-aa24-6780ee0ffe7c): created successfully Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22284ca1-41ca-4d48-b9b7-2904782c6576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (7a949a52-bc4f-44bd-a339-082bab5ed267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-97d5c348-248a-4561-8b71-4b8978e01461 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created volume successfully. Jul 07 09:33:39 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m" returned: 1 in 0.830s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e8e5ea25-efbc-44d9-9822-230b47d1609b_yasw1n4m' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[61db22a6-b06d-48b2-a0d9-5e1299fef9e2]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:39 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD Jul 07 09:33:39 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:40 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01d60b34-fa42-4a41-adac-00617011cd45" returned: 0 in 0.869s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-01d60b34-fa42-4a41-adac-00617011cd45" released by "delete_volume" :: held 1.840s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Created reservations ['c593bc26-67a0-46b0-bd57-c56f3da082cc', '8863c47c-a91c-42ae-b870-a11984ea4698', 'c9cfda92-cf8a-44ba-96d7-028c7fb67b58', 'ae4b67da-ea6f-4d00-8426-61ab14cdc6b8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:40 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:40 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:40 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 0 in 0.895s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c6fbc888-bc20-4045-b8a6-e772edb21888_wxoqb2gadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:33:40 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-0a501f99-9d1e-4b84-8326-3a07ea7d626b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:40 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 1G Jul 07 09:33:40 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-0a501f99-9d1e-4b84-8326-3a07ea7d626b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:40 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "cinder-quobyte-0a501f99-9d1e-4b84-8326-3a07ea7d626b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD" returned: 0 in 0.921s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-0a501f99-9d1e-4b84-8326-3a07ea7d626b" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa72e471-9649-45e1-a80a-9dbfb73b7a5c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:40 devstack sudo[106397]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca 1073741824" returned: 0 in 1.176s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:40 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca Jul 07 09:33:40 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:40 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b Jul 07 09:33:40 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:40 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD Jul 07 09:33:40 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:41 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.061s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Deleted volume successfully. Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ebb0b833-22ab-46e4-87d8-2878f4041ed7 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-01d60b34-fa42-4a41-adac-00617011cd45-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:41 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 1G" returned: 0 in 1.056s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bf0912-40fe-46c6-99c5-4e7cad8178a3]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:41 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD" returned: 1 in 1.026s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] e8e5ea25-efbc-44d9-9822-230b47d1609b was raw, converting to raw {{(pid=86769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:41 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:41 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:41 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca" returned: 0 in 0.914s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] <== create_volume: return (2145ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.215s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2137410478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2978fc97-58a1-49cb-80b0-2ad0fc26168c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:36Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating volume 2978fc97-58a1-49cb-80b0-2ad0fc26168c {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:41 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:41 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:41 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:41 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b" returned: 0 in 1.073s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:41 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c 1073741824 Jul 07 09:33:41 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b Jul 07 09:33:41 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:41 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f138a544-c00a-4170-a913-cd8788edf5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed5424f-1f8d-432e-b07b-cfde5a1acdd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca (9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca): created successfully Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ed5424f-1f8d-432e-b07b-cfde5a1acdd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (0be0603c-99ec-4631-9058-fc24749a58c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a3496fcc-330c-4553-92b5-00bd6b9811a2 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created volume successfully. Jul 07 09:33:42 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 0 in 0.938s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:42 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a501f99-9d1e-4b84-8326-3a07ea7d626b" returned: 0 in 0.751s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-quobyte-0a501f99-9d1e-4b84-8326-3a07ea7d626b" released by "delete_volume" :: held 1.872s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Created reservations ['e1d159b3-509f-406b-93b2-23e46789ad05', 'c17cb373-028c-45bb-8f5f-a2bfc7e7c75e', '16e38ffc-0056-4ae8-adf5-e212cd57ef09', '113cdcb1-b8b6-4654-9c67-dbbd022e0462'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:42 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 0 in 0.954s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e8e5ea25-efbc-44d9-9822-230b47d1609b_5quue0_pdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:33:42 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Converted 0.00 MB image at 0.00 MB/s Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:42 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:42 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:42 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef 1G Jul 07 09:33:42 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:42 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:42 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:42 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c 1073741824" returned: 0 in 1.258s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:43 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c Jul 07 09:33:43 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:43 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.963s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Deleted volume successfully. Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ecd2eb1-cc7a-4af9-a91d-c072156375e8 tempest-CreateVolumesFromImageTest-1294226668 None] Lock "cinder-0a501f99-9d1e-4b84-8326-3a07ea7d626b-delete_volume" released by "delete_volume" :: held 3.186s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:43 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 1 in 1.235s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Downloaded image c6fbc888-bc20-4045-b8a6-e772edb21888 ((None, [{'url': 'file:///opt/stack/data/glance/images/c6fbc888-bc20-4045-b8a6-e772edb21888', 'metadata': {}}])) to volume 172958b3-bdbf-4716-842f-0021f8d4f1b3 successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Temporary image c6fbc888-bc20-4045-b8a6-e772edb21888 for user 45a02983329546bea63dc2b200ed9159 is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Marking volume 172958b3-bdbf-4716-842f-0021f8d4f1b3 as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:33:43 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef 1G" returned: 0 in 1.122s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Copying metadata from image c6fbc888-bc20-4045-b8a6-e772edb21888 to 172958b3-bdbf-4716-842f-0021f8d4f1b3. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Creating volume glance metadata for volume 172958b3-bdbf-4716-842f-0021f8d4f1b3 backed by image c6fbc888-bc20-4045-b8a6-e772edb21888 with: {'image_id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '907bf850ea5993d62717dd93e26eac8c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[50590663-6a61-4b65-8e43-1243e3980f99]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c91a3d46-0ca7-4e78-9911-a6b7e153cc67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-172958b3-bdbf-4716-842f-0021f8d4f1b3', 'volume_size': 1, 'image_id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c6fbc888-bc20-4045-b8a6-e772edb21888', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '907bf850ea5993d62717dd93e26eac8c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a12da94d798a48ec9500145bbf3e51a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3dfdd6bae443d40d30bf81b80f7b4e92b53a0851f9d77000272dab633f7ef56241f7edbd79f07dc0b6c6bb38a2b4f7511b64f71c7e90f24cea24fa86fc00b372', 'id': 'c6fbc888-bc20-4045-b8a6-e772edb21888', 'created_at': datetime.datetime(2026, 7, 7, 7, 33, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 33, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c6fbc888-bc20-4045-b8a6-e772edb21888/file', 'properties': {}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614a79a3-d836-45c2-90a3-2192897ae631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:43 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Volume volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 (172958b3-bdbf-4716-842f-0021f8d4f1b3): created successfully Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614a79a3-d836-45c2-90a3-2192897ae631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Flow 'volume_create_manager' (b39886d7-22ee-4695-bead-8e9e84812a37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-44b7bd76-00a9-421e-a949-087545ed1339 tempest-VolumeImageDependencyTests-2129182456 None] Created volume successfully. Jul 07 09:33:43 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:43 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:43 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c" returned: 0 in 0.928s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.279s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.952s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177495263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9283ad1b-1a7e-496d-afa8-c78fb5b69aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:37Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating volume 9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:43 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820c35c9-71a5-43b6-935b-1c0524da3633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e88c9d-5562-4f35-8345-b87e2ca758ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:44 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 1073741824 Jul 07 09:33:44 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:44 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c (2978fc97-58a1-49cb-80b0-2ad0fc26168c): created successfully Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01e88c9d-5562-4f35-8345-b87e2ca758ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (c162ecc6-c60b-4dc4-8509-19511d27d9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:44 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-23877221-4b7b-4684-b800-f68b9b7712c1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created volume successfully. Jul 07 09:33:44 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Acquiring lock "cinder-172958b3-bdbf-4716-842f-0021f8d4f1b3-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 0 in 1.030s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Lock "cinder-172958b3-bdbf-4716-842f-0021f8d4f1b3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Acquiring lock "cinder-quobyte-172958b3-bdbf-4716-842f-0021f8d4f1b3" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Lock "cinder-quobyte-172958b3-bdbf-4716-842f-0021f8d4f1b3" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:44 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:44 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58fd200-2a10-473a-bcd6-c516daa48d2e]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:45 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:45 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:45 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 1073741824" returned: 0 in 1.195s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:45 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 Jul 07 09:33:45 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:45 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 1 in 0.911s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Downloaded image e8e5ea25-efbc-44d9-9822-230b47d1609b ((None, [{'url': 'file:///opt/stack/data/glance/images/e8e5ea25-efbc-44d9-9822-230b47d1609b', 'metadata': {}}])) to volume 8c1780f5-5d0d-4780-a627-70d949b0d7ef successfully. {{(pid=86769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Temporary image e8e5ea25-efbc-44d9-9822-230b47d1609b for user 74181e495b7a40959cfbb539741c574b is deleted. {{(pid=86769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.volume_utils [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Marking volume 8c1780f5-5d0d-4780-a627-70d949b0d7ef as bootable. {{(pid=86769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Copying metadata from image e8e5ea25-efbc-44d9-9822-230b47d1609b to 8c1780f5-5d0d-4780-a627-70d949b0d7ef. {{(pid=86769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Creating volume glance metadata for volume 8c1780f5-5d0d-4780-a627-70d949b0d7ef backed by image e8e5ea25-efbc-44d9-9822-230b47d1609b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ea814fe0209e0a19efe3ae499221cc26', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8e056bb-ea4a-4b6e-b2da-47c3b6defbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef', 'volume_size': 1, 'image_id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e8e5ea25-efbc-44d9-9822-230b47d1609b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ea814fe0209e0a19efe3ae499221cc26', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '611603c52e96485da58a66af8c89336f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '21b829e9ed2c159e446b7761b5728cf41e458b3793c9b89144b77e6f5af46853f859ea43cc0a30d151e5f0baf451ca6d7e0f983bae7ca86b311f55227532384b', 'id': 'e8e5ea25-efbc-44d9-9822-230b47d1609b', 'created_at': datetime.datetime(2026, 7, 7, 7, 33, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 7, 33, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e8e5ea25-efbc-44d9-9822-230b47d1609b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73eec98b-59e2-4f9f-8056-0386adc20172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:45 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Volume volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef (8c1780f5-5d0d-4780-a627-70d949b0d7ef): created successfully Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73eec98b-59e2-4f9f-8056-0386adc20172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Flow 'volume_create_manager' (04f324b9-5a09-40c0-9453-01fbda802e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:45 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e6a13b87-76da-46a0-bd56-4590ef60d6ce tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Created volume successfully. Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 0 in 0.912s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:45 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9" returned: 0 in 0.803s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.613s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1607443752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ee3e7feaf214d838ec2450edb2c071b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:37Z,use_quota=True,user_id='965e30a258fb4e19a0634a269365d753',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Creating volume b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:46 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:46 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:46 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Acquiring lock "cinder-8c1780f5-5d0d-4780-a627-70d949b0d7ef-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6b9efaa-035b-4812-bd5f-66adaa71e175) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:46 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 1073741824 Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec25d922-54ea-4f75-95e3-b34bafd618ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:46 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "cinder-8c1780f5-5d0d-4780-a627-70d949b0d7ef-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 (9283ad1b-1a7e-496d-afa8-c78fb5b69aa9): created successfully Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec25d922-54ea-4f75-95e3-b34bafd618ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (db6be938-3861-42cf-bcae-ba2ffccd9a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e39ce2c2-c80c-4552-b851-03e542656292 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created volume successfully. Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Acquiring lock "cinder-quobyte-8c1780f5-5d0d-4780-a627-70d949b0d7ef" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "cinder-quobyte-8c1780f5-5d0d-4780-a627-70d949b0d7ef" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[336dfa00-18fb-4cc6-af57-5cd834cccec3]: (4, 'raw') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:46 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:46 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:46 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 1 in 0.944s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:46 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3 Jul 07 09:33:46 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Flow 'volume_create_manager' (759c0294-033b-4c3d-910e-c43ed5006752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3ea316-6790-4171-a6b8-09162ca8e85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f3ea316-6790-4171-a6b8-09162ca8e85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1466567052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef1ad5e-0f26-4593-a033-4cfd23eec289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db49854a6cb248fe9db5f6fc83cd7472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:47Z,use_quota=True,user_id='0f391aa4052545d4a62b58e50b587900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a75556-c1dd-4444-a7cc-3f2034dddb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a75556-c1dd-4444-a7cc-3f2034dddb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb213a89-244e-4b6e-a8d9-186a05c20a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb213a89-244e-4b6e-a8d9-186a05c20a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef1ad5e-0f26-4593-a033-4cfd23eec289', 'volume_name': 'volume-aef1ad5e-0f26-4593-a033-4cfd23eec289', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f973d09-3087-4737-bd20-3d3514de69a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f973d09-3087-4737-bd20-3d3514de69a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8153e4cf-43da-4180-aeb4-aa715765ccee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Volume aef1ad5e-0f26-4593-a033-4cfd23eec289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef1ad5e-0f26-4593-a033-4cfd23eec289', 'volume_size': 1} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:47 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 1073741824" returned: 0 in 1.077s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:47 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 0 in 0.890s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:47 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 Jul 07 09:33:47 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:47 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:47 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:47 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-172958b3-bdbf-4716-842f-0021f8d4f1b3" returned: 0 in 0.759s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Lock "cinder-quobyte-172958b3-bdbf-4716-842f-0021f8d4f1b3" released by "delete_volume" :: held 2.697s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Created reservations ['686e129a-744a-438a-bf30-28298ca7b4d8', 'd64d9170-a6e2-4ec6-b720-b77166ece6d6', 'dcbb9de8-88cb-4b15-8f2e-166c3aa0b5c3', '7a1c39f1-6307-41b4-9874-751a72fcc50d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:47 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:47 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:47 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207" returned: 0 in 0.727s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.875s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1466567052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef1ad5e-0f26-4593-a033-4cfd23eec289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db49854a6cb248fe9db5f6fc83cd7472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:47Z,use_quota=True,user_id='0f391aa4052545d4a62b58e50b587900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Creating volume aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:47 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18576977-3c7a-41bc-beec-c58d665e5d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc539150-4a30-4918-9d32-ec44aac0f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Volume volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 (b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207): created successfully Jul 07 09:33:47 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 1073741824 Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc539150-4a30-4918-9d32-ec44aac0f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:47 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Flow 'volume_create_manager' (3da988ef-b9c1-4229-afe7-240b81730028) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:47 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 1 in 0.846s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef' failed. Not Retrying. {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 07 09:33:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-204fed41-a3ba-4da7-b6dd-c5c0e82f23c8 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created volume successfully. Jul 07 09:33:48 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef Jul 07 09:33:48 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:48 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.804s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Deleted volume successfully. Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-b75ac920-749e-46c1-bb50-61906fcce7cc tempest-VolumeImageDependencyTests-2129182456 None] Lock "cinder-172958b3-bdbf-4716-842f-0021f8d4f1b3-delete_volume" released by "delete_volume" :: held 3.724s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:48 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8c1780f5-5d0d-4780-a627-70d949b0d7ef" returned: 0 in 0.800s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "cinder-quobyte-8c1780f5-5d0d-4780-a627-70d949b0d7ef" released by "delete_volume" :: held 2.625s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd37ca1-680e-4f1f-bf0d-a24668572c67]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:48 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Created reservations ['ed5cd73b-5005-47f8-a187-d48ee5ec1459', '22fb0122-f84a-4d6f-bcbe-6e7b1545a56c', '406debe4-c3b1-47d4-b116-9d38da161929', '855ae513-cc0f-467f-a531-a39ca34a02b5'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:49 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 1073741824" returned: 0 in 1.119s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:49 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 Jul 07 09:33:49 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:49 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:49 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:49 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:33:49 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:49 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.956s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Deleted volume successfully. Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3ddbd43d-546e-4bcf-b816-33b116ce4248 tempest-VolumeAndVolumeTypeFromImageTest-2023152698 None] Lock "cinder-8c1780f5-5d0d-4780-a627-70d949b0d7ef-delete_volume" released by "delete_volume" :: held 3.975s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:50 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207" returned: 0 in 1.164s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:50 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 1.029s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] <== create_volume: return (2222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.227s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:50 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207 Jul 07 09:33:50 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8153e4cf-43da-4180-aeb4-aa715765ccee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef1ad5e-0f26-4593-a033-4cfd23eec289', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39be9f74-cca1-40d0-8467-d226063e01bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:50 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Volume volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 (aef1ad5e-0f26-4593-a033-4cfd23eec289): created successfully Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39be9f74-cca1-40d0-8467-d226063e01bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Flow 'volume_create_manager' (759c0294-033b-4c3d-910e-c43ed5006752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-29f7690f-245a-4648-b65d-25ab00141e4c tempest-VolumeDependencyTests-1284404019 None] Created volume successfully. Jul 07 09:33:50 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207" returned: 0 in 0.686s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207" released by "delete_volume" :: held 1.908s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['daf9fe33-b3b6-4bcc-8beb-b27b1b80265a', 'c6593de3-f1f7-498e-9e68-509634830d48', '28d941e8-35b8-476d-a287-4cb5cad121d0', '22507ca7-c3c2-4857-a6f1-8f4994738652'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:50 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:50 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda50186-28dc-4434-9ab9-8af11a824771]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:51 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 Jul 07 09:33:51 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Creating offline snapshot ff271f89-c451-4e6a-a4e5-b50490e3c5a3 of volume aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e8e4d1-dffd-4287-99e5-9f8d7c6568c9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:51 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:33:51 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:51 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.057s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:51 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleted volume successfully. Jul 07 09:33:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-62fb8bca-bb97-4c7f-bb52-905341d3d25b tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-b9ad1a3a-6bc0-4ed1-917f-68fcdecdd207-delete_volume" released by "delete_volume" :: held 3.250s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:52 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9" returned: 0 in 1.118s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:52 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9 Jul 07 09:33:52 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:52 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 1.129s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:52 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 1G Jul 07 09:33:52 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:53 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9" returned: 0 in 0.873s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9" released by "delete_volume" :: held 2.075s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['411e64bf-289c-4aeb-9527-77481b7ae9f3', '682a3043-70d0-44eb-a16e-e18b535da58b', '6179f207-11cc-4a7d-89f1-fde7fc5361cf', '5c7848e9-be3d-4ce1-8fd1-d4994e362f4a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:53 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:53 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:53 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 1G" returned: 0 in 1.012s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:53 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 Jul 07 09:33:53 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:54 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.799s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleted volume successfully. Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9d8b89f4-e370-4f9c-accd-52bb44c40324 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-9283ad1b-1a7e-496d-afa8-c78fb5b69aa9-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-2978fc97-58a1-49cb-80b0-2ad0fc26168c-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-2978fc97-58a1-49cb-80b0-2ad0fc26168c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-2978fc97-58a1-49cb-80b0-2ad0fc26168c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-2978fc97-58a1-49cb-80b0-2ad0fc26168c" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[107c2fea-c759-4a4a-9755-b9262f649ab1]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:54 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3" returned: 0 in 0.902s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:54 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 is being set with open permissions: ugo+rw Jul 07 09:33:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:54 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c Jul 07 09:33:54 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:54 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 Jul 07 09:33:54 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (0ea3d3f5-b183-4828-81c7-14191a8956d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3592b8-ac5c-4e68-ab42-c9412198c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e3592b8-ac5c-4e68-ab42-c9412198c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-963273747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec87fbe-441a-4314-9c6a-4734df1e03ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:55Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70eade16-a723-4214-b16b-6007cfeece98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70eade16-a723-4214-b16b-6007cfeece98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f03192-bf4b-467f-b4f3-0b6d16058767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f03192-bf4b-467f-b4f3-0b6d16058767) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cec87fbe-441a-4314-9c6a-4734df1e03ed', 'volume_name': 'volume-cec87fbe-441a-4314-9c6a-4734df1e03ed', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9da20b5-0ffd-49c8-98a3-8df99e33f2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9da20b5-0ffd-49c8-98a3-8df99e33f2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2b9cab-fc8d-43ce-80a6-541b4c2ca351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:55 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume cec87fbe-441a-4314-9c6a-4734df1e03ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cec87fbe-441a-4314-9c6a-4734df1e03ed', 'volume_size': 1} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:55 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:55 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c" returned: 0 in 0.933s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:55 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c Jul 07 09:33:55 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:55 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info Jul 07 09:33:55 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:56 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2978fc97-58a1-49cb-80b0-2ad0fc26168c" returned: 0 in 0.725s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-2978fc97-58a1-49cb-80b0-2ad0fc26168c" released by "delete_volume" :: held 1.704s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['22e3d084-1e91-422a-9874-5c3dbda88923', '5f568b92-8379-4e90-b079-018f812501b6', 'cc68acda-c0af-4708-9bbb-af17f152e866', 'dda23a96-09ab-4a5c-8d0f-31c5e0e8e230'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:56 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info" returned: 0 in 0.764s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:56 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info is being set with open permissions: ugo+rw Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:56 devstack sudo[106629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info Jul 07 09:33:56 devstack sudo[106629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:56 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:56 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2cb39-c3b8-4c5b-bc49-bae4ff246667]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:57 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca Jul 07 09:33:57 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:57 devstack sudo[106629]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.info" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.525s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.683s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-963273747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cec87fbe-441a-4314-9c6a-4734df1e03ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:55Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Creating volume cec87fbe-441a-4314-9c6a-4734df1e03ed {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:57 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:57 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed 1073741824 Jul 07 09:33:57 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d6acce5a-f132-4403-9c26-6d155975bc54 tempest-VolumeDependencyTests-1284404019 None] Create snapshot completed successfully Jul 07 09:33:57 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.790s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleted volume successfully. Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-22ea454c-fccf-416e-af5c-7ecb5ac20528 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-2978fc97-58a1-49cb-80b0-2ad0fc26168c-delete_volume" released by "delete_volume" :: held 2.756s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:57 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca" returned: 0 in 0.886s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:57 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca Jul 07 09:33:57 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:58 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed 1073741824" returned: 0 in 0.975s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:58 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed Jul 07 09:33:58 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:58 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca" returned: 0 in 0.747s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca" released by "delete_volume" :: held 1.705s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['53f8e173-24a4-41b3-a4c1-8bf9ccaa7d40', 'a8d06d65-f4fa-4029-83e0-be852d68ce56', '57b314d0-5f3e-41ca-9019-6821a8ecd231', '7c323bec-8469-436a-8ff2-20209a40a4f8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Flow 'volume_create_manager' (fff7fb06-d814-45ae-aa4c-d2f47f6707a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:58 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96257bd3-0bd6-47cf-8bbc-71c549faac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:58 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96257bd3-0bd6-47cf-8bbc-71c549faac0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-564513542',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05940279-a75e-4007-ba63-03068f5ae4c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db49854a6cb248fe9db5f6fc83cd7472',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ff271f89-c451-4e6a-a4e5-b50490e3c5a3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:59Z,use_quota=True,user_id='0f391aa4052545d4a62b58e50b587900',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63caf440-a3de-45f3-a164-35a1c04ddea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63caf440-a3de-45f3-a164-35a1c04ddea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d9d20-375c-41f8-8ef4-89694ec687cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb4d9d20-375c-41f8-8ef4-89694ec687cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '05940279-a75e-4007-ba63-03068f5ae4c4', 'volume_name': 'volume-05940279-a75e-4007-ba63-03068f5ae4c4', 'volume_size': 1, 'snapshot_id': 'ff271f89-c451-4e6a-a4e5-b50490e3c5a3'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46771322-b3e4-49eb-8a6a-e61817936c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46771322-b3e4-49eb-8a6a-e61817936c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da624fa8-6b16-43c6-89d4-1860bc40988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:58 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Volume 05940279-a75e-4007-ba63-03068f5ae4c4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-05940279-a75e-4007-ba63-03068f5ae4c4', 'volume_size': 1, 'snapshot_id': 'ff271f89-c451-4e6a-a4e5-b50490e3c5a3'} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:33:58 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (1ad08413-a0d3-4769-8b80-bb413d003bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bee253e-51fd-40ab-85fa-6bb047a87117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bee253e-51fd-40ab-85fa-6bb047a87117) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206717381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40460aea-940f-44ad-91cc-c6b8109fa776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:59Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c3c73c-e66d-4c6d-b462-16972bee4bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9c3c73c-e66d-4c6d-b462-16972bee4bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70caf210-dd8c-43b0-996b-6849612a0e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70caf210-dd8c-43b0-996b-6849612a0e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40460aea-940f-44ad-91cc-c6b8109fa776', 'volume_name': 'volume-40460aea-940f-44ad-91cc-c6b8109fa776', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d70e31-ebcc-4ab8-9678-f519a54714f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82d70e31-ebcc-4ab8-9678-f519a54714f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fe235c-f924-4b1f-900c-2d378ee5a931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:59 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Volume 40460aea-940f-44ad-91cc-c6b8109fa776: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40460aea-940f-44ad-91cc-c6b8109fa776', 'volume_size': 1} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:59 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed" returned: 0 in 0.899s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.145s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-quobyte-ff271f89-c451-4e6a-a4e5-b50490e3c5a3-05940279-a75e-4007-ba63-03068f5ae4c4" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-aab79201-c23b-463d-aa24-6780ee0ffe7c-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2b9cab-fc8d-43ce-80a6-541b4c2ca351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cec87fbe-441a-4314-9c6a-4734df1e03ed', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3241c3d4-9f74-4183-acfc-236b755895ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-ff271f89-c451-4e6a-a4e5-b50490e3c5a3-05940279-a75e-4007-ba63-03068f5ae4c4" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Creating volume 05940279-a75e-4007-ba63-03068f5ae4c4 from snapshot ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-quobyte-05940279-a75e-4007-ba63-03068f5ae4c4" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-aab79201-c23b-463d-aa24-6780ee0ffe7c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:59 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume volume-cec87fbe-441a-4314-9c6a-4734df1e03ed (cec87fbe-441a-4314-9c6a-4734df1e03ed): created successfully Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3241c3d4-9f74-4183-acfc-236b755895ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (0ea3d3f5-b183-4828-81c7-14191a8956d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-05940279-a75e-4007-ba63-03068f5ae4c4" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] snapshot: ff271f89-c451-4e6a-a4e5-b50490e3c5a3, volume: 05940279-a75e-4007-ba63-03068f5ae4c4, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:33:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ea018503-b697-46ff-9c89-e14f064bc7f3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created volume successfully. Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b0c450-ab47-4336-9fa0-3fb24055aaa1]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-aab79201-c23b-463d-aa24-6780ee0ffe7c" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-aab79201-c23b-463d-aa24-6780ee0ffe7c" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce94a038-2660-4786-9c3d-dff37d792690]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:33:59 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 Jul 07 09:33:59 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:59 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c Jul 07 09:33:59 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:33:59 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.769s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:33:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleted volume successfully. Jul 07 09:33:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-920265a9-0189-4f29-9f63-3727fdac6ce1 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-9dc3a0d3-22eb-4a7b-ba9a-c11e632098ca-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:00 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3" returned: 0 in 0.883s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef1ad5e-0f26-4593-a033-4cfd23eec289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d1f4a4-679e-4c55-a5e7-d0b211bfa61d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:00 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c" returned: 0 in 0.904s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (14f2910e-0e5d-486c-8a3d-50458a1ffb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:00 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c Jul 07 09:34:00 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65f5495-4def-43ab-b488-1d4aa9349056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d65f5495-4def-43ab-b488-1d4aa9349056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1612468847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fc23a3-87b9-47ca-87e8-fa09860459f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:00Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccd054a-db05-4032-ac29-dcd022fe8038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:34:00 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fccd054a-db05-4032-ac29-dcd022fe8038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d3de5e-12cf-4d1d-b724-313d6e4e0cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11d3de5e-12cf-4d1d-b724-313d6e4e0cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01fc23a3-87b9-47ca-87e8-fa09860459f5', 'volume_name': 'volume-01fc23a3-87b9-47ca-87e8-fa09860459f5', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b0ecb3-4405-4a4a-9849-619150aa2260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30b0ecb3-4405-4a4a-9849-619150aa2260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7136e1f0-3349-4689-9612-721f0ca75795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume 01fc23a3-87b9-47ca-87e8-fa09860459f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01fc23a3-87b9-47ca-87e8-fa09860459f5', 'volume_size': 1} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (eb4b962d-1067-4f6d-bd35-ec7b0fbf46db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424856ee-6775-43f5-aaa6-0de8ab461cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (424856ee-6775-43f5-aaa6-0de8ab461cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1665835689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09da2a2-6c66-4750-a5bb-d35c0f90f430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:01Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6f317f-a197-4589-bcde-b1d00f4621df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6f317f-a197-4589-bcde-b1d00f4621df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f85241-b697-42e9-9e93-9c09efeaed66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6f85241-b697-42e9-9e93-9c09efeaed66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f09da2a2-6c66-4750-a5bb-d35c0f90f430', 'volume_name': 'volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166da377-6afc-4eb2-8ed3-2fa415b3967c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (166da377-6afc-4eb2-8ed3-2fa415b3967c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c10714-b9ed-40e2-b8fa-9e2ac92de8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:00 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume f09da2a2-6c66-4750-a5bb-d35c0f90f430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430', 'volume_size': 1} Jul 07 09:34:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:01 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 0.960s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:01 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (b63c3fb3-1a28-467a-856a-917cbbf7dcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:01 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:01 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5838b9-6212-43c1-98c8-6dc8076e2764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aab79201-c23b-463d-aa24-6780ee0ffe7c" returned: 0 in 0.958s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a5838b9-6212-43c1-98c8-6dc8076e2764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363183148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549d4723-ea97-4f16-aa9c-60521a0b5563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:01Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57049969-7448-4a4c-ae0d-5e0f10a2b4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57049969-7448-4a4c-ae0d-5e0f10a2b4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330a2ae7-84f3-4147-89c6-69e1130c566d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330a2ae7-84f3-4147-89c6-69e1130c566d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549d4723-ea97-4f16-aa9c-60521a0b5563', 'volume_name': 'volume-549d4723-ea97-4f16-aa9c-60521a0b5563', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8168db-bda3-4b3f-a50e-5523e6aad7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd8168db-bda3-4b3f-a50e-5523e6aad7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef35acb8-7f08-42e8-b007-7a7f3b44ae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume 549d4723-ea97-4f16-aa9c-60521a0b5563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549d4723-ea97-4f16-aa9c-60521a0b5563', 'volume_size': 1} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-aab79201-c23b-463d-aa24-6780ee0ffe7c" released by "delete_volume" :: held 1.954s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['6cb384e7-b1f0-4ea1-ba1e-1586f6a342ee', 'c4084025-6343-46c9-b43e-72202d25aeb8', '886d4cea-299d-439d-a06c-9c6d9c19e599', '3bb94c5f-1f1d-4266-8936-7c0c7b02fda9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:01 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:01 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-4479a8e9-4ebb-451c-90e1-79b3d0720690-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-4479a8e9-4ebb-451c-90e1-79b3d0720690-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-afea2f69-ed6c-41b2-a084-ec90a74228e9" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-afea2f69-ed6c-41b2-a084-ec90a74228e9" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-4479a8e9-4ebb-451c-90e1-79b3d0720690" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (7d56266c-f5a9-4585-b796-2e1f5574ea74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cbc808-750e-42ca-aac4-e95613085352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-4479a8e9-4ebb-451c-90e1-79b3d0720690" acquired by "_delete_snapshot" :: waited 0.067s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleting offline snapshot 4479a8e9-4ebb-451c-90e1-79b3d0720690 of volume afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] snapshot_file for this snap is: volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50cbc808-750e-42ca-aac4-e95613085352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236457906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d12121e-d30f-488f-abee-ce26a19ba8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:02Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ab7616-4d88-4445-bc5d-dc6ba113cfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2ab7616-4d88-4445-bc5d-dc6ba113cfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e8571e-5b2c-4a97-be60-16fdb75d94b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e8571e-5b2c-4a97-be60-16fdb75d94b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d12121e-d30f-488f-abee-ce26a19ba8be', 'volume_name': 'volume-6d12121e-d30f-488f-abee-ce26a19ba8be', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a83b2-6e51-4278-a8f5-0b6d25d013f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb4a83b2-6e51-4278-a8f5-0b6d25d013f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bde8a3-eefe-4281-ab91-d5cbc9d59f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:01 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume 6d12121e-d30f-488f-abee-ce26a19ba8be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d12121e-d30f-488f-abee-ce26a19ba8be', 'volume_size': 1} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c7cd9f-eeb7-4e6b-9e99-47879e858c44]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:01 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 Jul 07 09:34:01 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:01 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (25c0e6d5-b0b2-4b93-9155-1cecfca51843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2093df36-2a5f-4d5b-b432-df49bb299ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2093df36-2a5f-4d5b-b432-df49bb299ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517809947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf15d55b-0cd2-4a85-9713-39f418356553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:02Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332a5922-abe4-426b-bb90-e436c4c58131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332a5922-abe4-426b-bb90-e436c4c58131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed40005c-379d-4839-92ef-658d2b8b08c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed40005c-379d-4839-92ef-658d2b8b08c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf15d55b-0cd2-4a85-9713-39f418356553', 'volume_name': 'volume-bf15d55b-0cd2-4a85-9713-39f418356553', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fe1560-7fb8-4a30-83d2-5352ed7e6e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82fe1560-7fb8-4a30-83d2-5352ed7e6e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a292b4-11de-4e1e-9df2-6b08f774a92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:02 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume bf15d55b-0cd2-4a85-9713-39f418356553: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf15d55b-0cd2-4a85-9713-39f418356553', 'volume_size': 1} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:02 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.873s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:02 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleted volume successfully. Jul 07 09:34:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4fcf48ab-32fe-41aa-88fb-8dc390ae1193 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-aab79201-c23b-463d-aa24-6780ee0ffe7c-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:03 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690" returned: 0 in 1.357s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afea2f69-ed6c-41b2-a084-ec90a74228e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:03 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fddaf2-7c90-430b-a2de-16c78f74db0c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:03 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 Jul 07 09:34:03 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:04 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9" returned: 0 in 1.668s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:04 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 Jul 07 09:34:04 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:06 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690" returned: 0 in 1.475s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:06 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690 Jul 07 09:34:06 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:06 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4" returned: 0 in 5.589s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dc7aeb-1470-4382-8ada-30559b90d1f4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:06 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:34:06 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:07 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9.4479a8e9-4ebb-451c-90e1-79b3d0720690" returned: 0 in 0.834s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-4479a8e9-4ebb-451c-90e1-79b3d0720690" released by "_delete_snapshot" :: held 5.569s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-afea2f69-ed6c-41b2-a084-ec90a74228e9" released by "delete_snapshot" :: held 5.646s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['d31a75d0-3195-4e65-a557-326ce3b2689c', '399040e8-25ae-42d9-b9ee-486654b1fcd9', '92009979-c2dd-468b-bbdf-753ebf6fb5f6', '6949a221-751c-45d6-be62-33056e652a5c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Delete snapshot completed successfully. Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-68ce2ab6-47b3-4cd9-a624-1ec0e8a38ecc tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-4479a8e9-4ebb-451c-90e1-79b3d0720690-delete_snapshot" released by "delete_snapshot" :: held 5.817s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:07 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 0.977s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:34:07 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Converted 1024.00 MB image at 183.16 MB/s Jul 07 09:34:07 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 is being set with open permissions: ugo+rw Jul 07 09:34:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:07 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 Jul 07 09:34:07 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-afea2f69-ed6c-41b2-a084-ec90a74228e9-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-afea2f69-ed6c-41b2-a084-ec90a74228e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "cinder-quobyte-afea2f69-ed6c-41b2-a084-ec90a74228e9" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-afea2f69-ed6c-41b2-a084-ec90a74228e9" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c173811-9ac0-4902-83b7-b5e7c38dc591]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:08 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 Jul 07 09:34:08 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:08 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4" returned: 0 in 0.640s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-05940279-a75e-4007-ba63-03068f5ae4c4" released by "_copy_volume_from_snapshot" :: held 9.161s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-ff271f89-c451-4e6a-a4e5-b50490e3c5a3-05940279-a75e-4007-ba63-03068f5ae4c4" released by "_create_volume_from_snapshot" :: held 9.224s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.265s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.322s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:33:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-206717381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40460aea-940f-44ad-91cc-c6b8109fa776,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:33:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:33:59Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Creating volume 40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:08 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:08 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 1073741824 Jul 07 09:34:08 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da624fa8-6b16-43c6-89d4-1860bc40988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05940279-a75e-4007-ba63-03068f5ae4c4', 'volume_size': 1, 'snapshot_id': 'ff271f89-c451-4e6a-a4e5-b50490e3c5a3'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec8f329-2a0e-4366-93b8-1b0bc39caa1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:08 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Volume volume-05940279-a75e-4007-ba63-03068f5ae4c4 (05940279-a75e-4007-ba63-03068f5ae4c4): created successfully Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec8f329-2a0e-4366-93b8-1b0bc39caa1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Flow 'volume_create_manager' (fff7fb06-d814-45ae-aa4c-d2f47f6707a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:08 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5ab772e7-3754-4a0a-852d-7080a192f1f8 tempest-VolumeDependencyTests-1284404019 None] Created volume successfully. Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-ff271f89-c451-4e6a-a4e5-b50490e3c5a3-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-ff271f89-c451-4e6a-a4e5-b50490e3c5a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-quobyte-aef1ad5e-0f26-4593-a033-4cfd23eec289" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-aef1ad5e-0f26-4593-a033-4cfd23eec289" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-quobyte-ff271f89-c451-4e6a-a4e5-b50490e3c5a3" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-ff271f89-c451-4e6a-a4e5-b50490e3c5a3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Deleting offline snapshot ff271f89-c451-4e6a-a4e5-b50490e3c5a3 of volume aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] snapshot_file for this snap is: volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[55422c42-410a-432f-893d-5ee3d134940b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:09 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9" returned: 0 in 0.856s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:09 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 Jul 07 09:34:09 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:09 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9 Jul 07 09:34:09 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:09 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 1073741824" returned: 0 in 0.897s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=127,cinder:UPDATE=155,cinder:INSERT=50,cinder:DELETE=15 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:09 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 Jul 07 09:34:09 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:09 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-afea2f69-ed6c-41b2-a084-ec90a74228e9" returned: 0 in 0.700s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-quobyte-afea2f69-ed6c-41b2-a084-ec90a74228e9" released by "delete_volume" :: held 1.616s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:09 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef1ad5e-0f26-4593-a033-4cfd23eec289(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9c8c84-7cf0-4f76-944f-6323752bac2d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=124,cinder:UPDATE=164,cinder:DELETE=15,cinder:INSERT=39 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Created reservations ['64a275c0-5079-43d8-9c43-2a07d56fa39d', 'd2dc4669-ab33-404f-84cd-018ac33da794', '3a6313e8-f81d-44dd-aa8d-f78187d7f443', '890b2839-1a26-4383-88fd-45d75fa9b931'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:09 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:34:09 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:10 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:10 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:10 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776" returned: 0 in 0.715s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1664ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.668s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.679s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1612468847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01fc23a3-87b9-47ca-87e8-fa09860459f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:00Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Creating volume 01fc23a3-87b9-47ca-87e8-fa09860459f5 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:10 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fe235c-f924-4b1f-900c-2d378ee5a931) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40460aea-940f-44ad-91cc-c6b8109fa776', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:10 devstack sudo[106745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 1073741824 Jul 07 09:34:10 devstack sudo[106745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0f3ccb-7004-4aae-9fd1-2eb7d85fb414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:10 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Volume volume-40460aea-940f-44ad-91cc-c6b8109fa776 (40460aea-940f-44ad-91cc-c6b8109fa776): created successfully Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a0f3ccb-7004-4aae-9fd1-2eb7d85fb414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (1ad08413-a0d3-4769-8b80-bb413d003bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d3979a0f-e68b-4943-8fba-80fc7a247583 tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:34:10 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 0.837s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:10 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 Jul 07 09:34:10 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:10 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.750s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Deleted volume successfully. Jul 07 09:34:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9e4a57fc-9bf1-4240-b2bb-56448daf7438 tempest-CreateVolumesFromSnapshotTest-104972955 None] Lock "cinder-afea2f69-ed6c-41b2-a084-ec90a74228e9-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:11 devstack sudo[106745]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 1073741824" returned: 0 in 1.021s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:11 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 Jul 07 09:34:11 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:11 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3" returned: 0 in 0.953s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:11 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3 Jul 07 09:34:11 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:11 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5" returned: 0 in 0.822s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] <== create_volume: return (1899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.165s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1665835689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f09da2a2-6c66-4750-a5bb-d35c0f90f430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:01Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Creating volume f09da2a2-6c66-4750-a5bb-d35c0f90f430 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7136e1f0-3349-4689-9612-721f0ca75795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01fc23a3-87b9-47ca-87e8-fa09860459f5', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:12 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 1073741824 Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de7457f-2017-4000-b873-ae4972585138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:12 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 (01fc23a3-87b9-47ca-87e8-fa09860459f5): created successfully Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0de7457f-2017-4000-b873-ae4972585138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (14f2910e-0e5d-486c-8a3d-50458a1ffb5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9ad7d2bd-51d1-4251-a857-8a99c3ce0d29 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created volume successfully. Jul 07 09:34:12 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289.ff271f89-c451-4e6a-a4e5-b50490e3c5a3" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-ff271f89-c451-4e6a-a4e5-b50490e3c5a3" released by "_delete_snapshot" :: held 3.490s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-aef1ad5e-0f26-4593-a033-4cfd23eec289" released by "delete_snapshot" :: held 3.519s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Created reservations ['c994f474-bb65-48be-b7cb-48b59d362c1c', '31d0b0e6-79e7-4208-9ccc-ba83f689857b', '0867d72b-92b2-4ede-a878-f79bf8359699', '5dfd6069-6ad7-4033-ac31-3a84901b5374'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Delete snapshot completed successfully. Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9b07fb38-3097-4442-b891-e519ba1f999f tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-ff271f89-c451-4e6a-a4e5-b50490e3c5a3-delete_snapshot" released by "delete_snapshot" :: held 3.698s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:12 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 1073741824" returned: 0 in 0.892s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:12 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 Jul 07 09:34:12 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-aef1ad5e-0f26-4593-a033-4cfd23eec289-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-aef1ad5e-0f26-4593-a033-4cfd23eec289-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-quobyte-aef1ad5e-0f26-4593-a033-4cfd23eec289" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-aef1ad5e-0f26-4593-a033-4cfd23eec289" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c215be16-5d12-4afc-8378-4fc5ae7da1f5]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:13 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:34:13 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:13 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430" returned: 0 in 0.697s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.345s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-363183148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549d4723-ea97-4f16-aa9c-60521a0b5563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:01Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Creating volume 549d4723-ea97-4f16-aa9c-60521a0b5563 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:13 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:13 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 1073741824 Jul 07 09:34:13 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c10714-b9ed-40e2-b8fa-9e2ac92de8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c8c742-7679-4aa1-9dc7-ddb31ccc3fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:13 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 (f09da2a2-6c66-4750-a5bb-d35c0f90f430): created successfully Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78c8c742-7679-4aa1-9dc7-ddb31ccc3fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:13 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (eb4b962d-1067-4f6d-bd35-ec7b0fbf46db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-bdcd856f-e1c7-4ed5-b6b1-494a669c8006 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created volume successfully. Jul 07 09:34:14 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:14 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289 Jul 07 09:34:14 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-ed5304e2-e8a2-4851-ae2c-0d385e28324c tempest-ProjectAdminTests-1991200153 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 07 09:34:14 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 1073741824" returned: 0 in 0.868s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:14 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 Jul 07 09:34:14 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:14 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef1ad5e-0f26-4593-a033-4cfd23eec289" returned: 0 in 0.687s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-aef1ad5e-0f26-4593-a033-4cfd23eec289" released by "delete_volume" :: held 1.573s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Created reservations ['7a2e8151-dcc0-4e91-b148-3ca7ea61fd9e', '18a55878-ab40-4212-86b7-956a7fffdb25', '6a162734-780c-4296-b79b-cfa332e8bd1d', 'a6204ed2-52bb-45e2-92e0-dc20f0c1fffb'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:14 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:14 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:15 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563" returned: 0 in 0.718s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.480s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-236457906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d12121e-d30f-488f-abee-ce26a19ba8be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:02Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Creating volume 6d12121e-d30f-488f-abee-ce26a19ba8be {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:15 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef35acb8-7f08-42e8-b007-7a7f3b44ae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549d4723-ea97-4f16-aa9c-60521a0b5563', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443ab464-fe43-49cd-bd42-a01c700edba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:15 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be 1073741824 Jul 07 09:34:15 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:15 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume volume-549d4723-ea97-4f16-aa9c-60521a0b5563 (549d4723-ea97-4f16-aa9c-60521a0b5563): created successfully Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443ab464-fe43-49cd-bd42-a01c700edba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (b63c3fb3-1a28-467a-856a-917cbbf7dcfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9d4b10dd-5c8b-456a-bda5-09a2d953b9a4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created volume successfully. Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-05940279-a75e-4007-ba63-03068f5ae4c4-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-05940279-a75e-4007-ba63-03068f5ae4c4-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "cinder-quobyte-05940279-a75e-4007-ba63-03068f5ae4c4" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-05940279-a75e-4007-ba63-03068f5ae4c4" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[509c0c96-9321-4a93-9ced-ee83169f7c5a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:15 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Deleted volume successfully. Jul 07 09:34:15 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 Jul 07 09:34:15 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-370f691f-3aba-42e3-b801-5333f4811aeb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-aef1ad5e-0f26-4593-a033-4cfd23eec289-delete_volume" released by "delete_volume" :: held 2.633s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:16 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be 1073741824" returned: 0 in 1.002s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:16 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be Jul 07 09:34:16 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:16 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4" returned: 0 in 0.925s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:16 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4 Jul 07 09:34:16 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:17 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be" returned: 0 in 0.730s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.973s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517809947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf15d55b-0cd2-4a85-9713-39f418356553,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f933cde4aef4898b4dcbe7cdbd8fcf3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:02Z,use_quota=True,user_id='fb400df41b554c929f53fccb6e1725c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Creating volume bf15d55b-0cd2-4a85-9713-39f418356553 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:17 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bde8a3-eefe-4281-ab91-d5cbc9d59f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d12121e-d30f-488f-abee-ce26a19ba8be', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:17 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 1073741824 Jul 07 09:34:17 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0648b53-0e13-4f4d-aebc-fcc6337fda95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:17 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume volume-6d12121e-d30f-488f-abee-ce26a19ba8be (6d12121e-d30f-488f-abee-ce26a19ba8be): created successfully Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0648b53-0e13-4f4d-aebc-fcc6337fda95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (7d56266c-f5a9-4585-b796-2e1f5574ea74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5d25b7d4-09dd-440d-85d6-9b2b27d63eb3 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created volume successfully. Jul 07 09:34:17 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-05940279-a75e-4007-ba63-03068f5ae4c4" returned: 0 in 0.741s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-quobyte-05940279-a75e-4007-ba63-03068f5ae4c4" released by "delete_volume" :: held 1.723s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Created reservations ['dea29599-22d3-4e90-9037-0a3dcea577e7', '9b498181-1364-4717-94fb-7370b7ce8151', '76706925-43ec-42c0-b33b-a088a2da12bb', 'c5047108-b7a2-4b72-a58c-b070eca6d7a1'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:17 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:17 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:18 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 1073741824" returned: 0 in 0.978s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:18 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 Jul 07 09:34:18 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:18 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.791s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Deleted volume successfully. Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a251132f-7620-44b5-ab5b-0ba8cbb5efcb tempest-VolumeDependencyTests-1284404019 None] Lock "cinder-05940279-a75e-4007-ba63-03068f5ae4c4-delete_volume" released by "delete_volume" :: held 2.820s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:18 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553" returned: 0 in 0.720s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.143s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90a292b4-11de-4e1e-9df2-6b08f774a92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf15d55b-0cd2-4a85-9713-39f418356553', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc25c76-cb99-4044-bfd4-85d4bb84d096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot 3658f94a-f24d-4403-8e2f-c2dd0df44847 of volume 40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:34:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Volume volume-bf15d55b-0cd2-4a85-9713-39f418356553 (bf15d55b-0cd2-4a85-9713-39f418356553): created successfully Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc25c76-cb99-4044-bfd4-85d4bb84d096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Flow 'volume_create_manager' (25c0e6d5-b0b2-4b93-9155-1cecfca51843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3462758f-13e3-4b95-a8e1-4783e7276cdc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-261b5872-a1c8-401f-859d-2d5e2fe8d413 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created volume successfully. Jul 07 09:34:19 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 Jul 07 09:34:19 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:19 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776" returned: 0 in 0.858s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-bf15d55b-0cd2-4a85-9713-39f418356553-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:19 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 1G Jul 07 09:34:19 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-bf15d55b-0cd2-4a85-9713-39f418356553-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-quobyte-bf15d55b-0cd2-4a85-9713-39f418356553" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-bf15d55b-0cd2-4a85-9713-39f418356553" acquired by "delete_volume" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b0a8e8-0ecd-4cc9-9f95-fd4f50c6f066]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:20 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 Jul 07 09:34:20 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:20 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 1G" returned: 0 in 1.071s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40460aea-940f-44ad-91cc-c6b8109fa776 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:20 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40460aea-940f-44ad-91cc-c6b8109fa776 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 Jul 07 09:34:20 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:20 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553" returned: 0 in 1.022s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:20 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553 Jul 07 09:34:20 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:21 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40460aea-940f-44ad-91cc-c6b8109fa776 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847" returned: 0 in 0.926s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:21 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 is being set with open permissions: ugo+rw Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:21 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 Jul 07 09:34:21 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:21 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-bf15d55b-0cd2-4a85-9713-39f418356553" returned: 0 in 0.852s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-bf15d55b-0cd2-4a85-9713-39f418356553" released by "delete_volume" :: held 1.928s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created reservations ['70935e7e-c151-42e1-a348-0261ecb06cff', '9891946b-fe36-4d77-8d19-c6dda7d3b337', '74a8ba39-d17a-48d4-baa1-c5402fd1c3fa', '7687b119-eba8-4b50-a4ee-456c385780a5'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:22 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:22 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-6d12121e-d30f-488f-abee-ce26a19ba8be-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-6d12121e-d30f-488f-abee-ce26a19ba8be-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-quobyte-6d12121e-d30f-488f-abee-ce26a19ba8be" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-6d12121e-d30f-488f-abee-ce26a19ba8be" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a1b40c-71ca-4f17-8516-79a96856cd42]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:22 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be Jul 07 09:34:22 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:22 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847" returned: 0 in 0.927s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:22 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info Jul 07 09:34:22 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:22 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.015s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:22 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Deleted volume successfully. Jul 07 09:34:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4bef9713-0435-4bb7-bb31-35ef721ef867 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-bf15d55b-0cd2-4a85-9713-39f418356553-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:23 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be" returned: 0 in 1.090s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:23 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be Jul 07 09:34:23 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:23 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info" returned: 0 in 0.917s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:23 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info is being set with open permissions: ugo+rw Jul 07 09:34:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:23 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info Jul 07 09:34:23 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:24 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6d12121e-d30f-488f-abee-ce26a19ba8be" returned: 0 in 0.742s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-6d12121e-d30f-488f-abee-ce26a19ba8be" released by "delete_volume" :: held 1.890s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created reservations ['227d5134-d7bf-4683-b103-edc8f5cc6b89', '19864bc9-f318-4c7f-ac76-a5376f3325e7', '0d0327ec-1fa5-4677-a313-fb88a6bc3f43', '8fb950e5-e6fc-4470-a92e-0c1e3b32d3fd'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:24 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:24 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-549d4723-ea97-4f16-aa9c-60521a0b5563-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:24 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.info" returned: 0 in 0.887s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.771s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-549d4723-ea97-4f16-aa9c-60521a0b5563-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cf415622-75b9-43a9-a305-b315fce525a0 tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-quobyte-549d4723-ea97-4f16-aa9c-60521a0b5563" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-549d4723-ea97-4f16-aa9c-60521a0b5563" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3c610e-09d7-44ee-8270-36c8f3974f02]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:24 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 Jul 07 09:34:24 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-3658f94a-f24d-4403-8e2f-c2dd0df44847-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Lock "cinder-3658f94a-f24d-4403-8e2f-c2dd0df44847-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-40460aea-940f-44ad-91cc-c6b8109fa776" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-40460aea-940f-44ad-91cc-c6b8109fa776" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-3658f94a-f24d-4403-8e2f-c2dd0df44847" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:25 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.148s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-3658f94a-f24d-4403-8e2f-c2dd0df44847" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot 3658f94a-f24d-4403-8e2f-c2dd0df44847 of volume 40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Deleted volume successfully. Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[81788910-2df4-4653-91c0-341cf5c0563c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c5b8e698-1c82-4558-88cc-17a8adae89bb tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-6d12121e-d30f-488f-abee-ce26a19ba8be-delete_volume" released by "delete_volume" :: held 3.446s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:25 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563" returned: 0 in 1.013s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:25 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 Jul 07 09:34:25 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:25 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563 Jul 07 09:34:25 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (0464ccd0-0e35-4501-9f7e-1f0e24449791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc9272a-44de-4eca-a40b-408f1a24a7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc9272a-44de-4eca-a40b-408f1a24a7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679355804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef91e58-3002-4188-a7cf-87dd36cf3986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:26Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd34db0-7cdc-4605-9c47-31793a928ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdd34db0-7cdc-4605-9c47-31793a928ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab02605-8181-4ecd-bd7d-fb2bb687d75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab02605-8181-4ecd-bd7d-fb2bb687d75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aef91e58-3002-4188-a7cf-87dd36cf3986', 'volume_name': 'volume-aef91e58-3002-4188-a7cf-87dd36cf3986', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d3334d-7f52-4d0e-a91e-68244e332217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d3334d-7f52-4d0e-a91e-68244e332217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19871440-b37d-429a-87f1-be6f2dde901d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:26 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Volume aef91e58-3002-4188-a7cf-87dd36cf3986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aef91e58-3002-4188-a7cf-87dd36cf3986', 'volume_size': 1} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-679355804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aef91e58-3002-4188-a7cf-87dd36cf3986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:26Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Creating volume aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:26 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:26 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 1073741824 Jul 07 09:34:26 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:26 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-549d4723-ea97-4f16-aa9c-60521a0b5563" returned: 0 in 0.832s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-549d4723-ea97-4f16-aa9c-60521a0b5563" released by "delete_volume" :: held 1.906s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created reservations ['f0319bd0-2c54-4bba-a2d4-37783a8833ea', '070df065-7c94-43a2-9aa6-359de5d719a5', '58fff30f-d59f-4dea-8c74-ff565a3df3a5', '2a830f80-67b1-4419-9307-10fd121e6882'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:26 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847" returned: 0 in 1.126s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40460aea-940f-44ad-91cc-c6b8109fa776(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26f541b-235c-4cab-ad7f-ad2c8d4b72f7]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:26 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:26 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-f09da2a2-6c66-4750-a5bb-d35c0f90f430-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:26 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-f09da2a2-6c66-4750-a5bb-d35c0f90f430-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:26 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-quobyte-f09da2a2-6c66-4750-a5bb-d35c0f90f430" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:27 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:27 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-f09da2a2-6c66-4750-a5bb-d35c0f90f430" acquired by "delete_volume" :: waited 0.044s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e235bf0b-e568-481d-87ea-10a4245898eb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:27 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 Jul 07 09:34:27 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:27 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 1073741824" returned: 0 in 1.221s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:27 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 Jul 07 09:34:27 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:27 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:34:27 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 1.064s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Deleted volume successfully. Jul 07 09:34:27 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f5fe0d8-111e-4f2f-a262-db8b3591294d tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-549d4723-ea97-4f16-aa9c-60521a0b5563-delete_volume" released by "delete_volume" :: held 3.290s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:28 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776" returned: 0 in 1.440s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:28 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 Jul 07 09:34:28 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:28 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430" returned: 0 in 1.133s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:28 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430 Jul 07 09:34:28 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:28 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986" returned: 0 in 0.966s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] <== create_volume: return (2268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.271s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19871440-b37d-429a-87f1-be6f2dde901d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aef91e58-3002-4188-a7cf-87dd36cf3986', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2cca28-401c-49df-afbc-33090b693b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:28 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Volume volume-aef91e58-3002-4188-a7cf-87dd36cf3986 (aef91e58-3002-4188-a7cf-87dd36cf3986): created successfully Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2cca28-401c-49df-afbc-33090b693b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (0464ccd0-0e35-4501-9f7e-1f0e24449791) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:28 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-55517018-5c67-43a4-ac56-753d738664fe tempest-ProjectReaderTests-1538320467 None] Created volume successfully. Jul 07 09:34:28 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:29 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847 Jul 07 09:34:29 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:29 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f09da2a2-6c66-4750-a5bb-d35c0f90f430" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-f09da2a2-6c66-4750-a5bb-d35c0f90f430" released by "delete_volume" :: held 1.982s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created reservations ['0e194c52-8192-4769-9fe4-1858c6bab432', 'bc064487-7cb2-410b-b0ce-8ab4fc016924', 'ed2fc958-add2-43ee-8fb8-4f93942dab7f', '4c1cd7fb-1732-4ec5-bb97-b414c8685c0b'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:29 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:29 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-01fc23a3-87b9-47ca-87e8-fa09860459f5-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-01fc23a3-87b9-47ca-87e8-fa09860459f5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-quobyte-01fc23a3-87b9-47ca-87e8-fa09860459f5" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-01fc23a3-87b9-47ca-87e8-fa09860459f5" acquired by "delete_volume" :: waited 0.037s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20be070-b70e-4c25-ab2f-6ff3a646c863]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:29 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 Jul 07 09:34:29 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Creating offline snapshot ce6223c7-eae6-49fb-bb8c-50ab007d2e5c of volume aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b57b735-c7fb-4986-ac7a-cdf5ad384a5c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:29 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 Jul 07 09:34:29 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:30 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776.3658f94a-f24d-4403-8e2f-c2dd0df44847" returned: 0 in 1.048s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-3658f94a-f24d-4403-8e2f-c2dd0df44847" released by "_delete_snapshot" :: held 4.629s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-40460aea-940f-44ad-91cc-c6b8109fa776" released by "delete_snapshot" :: held 4.704s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:30 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.927s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Deleted volume successfully. Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-dfdcaa9a-ffbc-43a2-bc01-f6fbb27d6ef4 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-f09da2a2-6c66-4750-a5bb-d35c0f90f430-delete_volume" released by "delete_volume" :: held 3.251s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Created reservations ['cc32f09d-8840-43dd-877c-003903976c91', 'd76a7f06-83c7-4f73-9a09-b11b6e998c37', '1257d321-7599-4af8-bf3d-dd06e67ef111', '91d8ffea-38a2-462c-a555-1d68fdb05561'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-56ecda8b-b2ad-4e35-a75d-04f64cb0ff6b tempest-ProjectMemberTests-1478510747 None] Lock "cinder-3658f94a-f24d-4403-8e2f-c2dd0df44847-delete_snapshot" released by "delete_snapshot" :: held 4.925s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:30 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5" returned: 0 in 1.004s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:30 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5 Jul 07 09:34:30 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:30 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986" returned: 0 in 0.895s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:30 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c 1G Jul 07 09:34:30 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-40460aea-940f-44ad-91cc-c6b8109fa776-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-40460aea-940f-44ad-91cc-c6b8109fa776-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-40460aea-940f-44ad-91cc-c6b8109fa776" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-40460aea-940f-44ad-91cc-c6b8109fa776" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c470065-68b6-4a1b-817a-6f0493e5715c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:31 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 Jul 07 09:34:31 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:31 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-01fc23a3-87b9-47ca-87e8-fa09860459f5" returned: 0 in 0.774s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-01fc23a3-87b9-47ca-87e8-fa09860459f5" released by "delete_volume" :: held 1.850s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created reservations ['3b545c8a-1449-4fdf-a642-97b50447ed0a', 'bdb9095d-d301-4a4f-9990-b35a9dff4643', 'a86c38fb-5ae3-458d-8c04-ff84a790813d', '99c6bda0-4dc3-46eb-9e82-57a92a7fe60a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:31 devstack sudo[106945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:31 devstack sudo[106945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-cec87fbe-441a-4314-9c6a-4734df1e03ed-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-cec87fbe-441a-4314-9c6a-4734df1e03ed-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "cinder-quobyte-cec87fbe-441a-4314-9c6a-4734df1e03ed" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-cec87fbe-441a-4314-9c6a-4734df1e03ed" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae08144-adc4-48b4-9f3d-c126d41f6e16]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:31 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c 1G" returned: 0 in 1.192s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef91e58-3002-4188-a7cf-87dd36cf3986 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:31 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef91e58-3002-4188-a7cf-87dd36cf3986 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c Jul 07 09:34:31 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:31 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed Jul 07 09:34:31 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:32 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776" returned: 0 in 1.099s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:32 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776 Jul 07 09:34:32 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:32 devstack sudo[106945]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.818s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Deleted volume successfully. Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a6a9dd4a-5f10-406f-a123-c16c99d5ecf1 tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-01fc23a3-87b9-47ca-87e8-fa09860459f5-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:32 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-40460aea-940f-44ad-91cc-c6b8109fa776" returned: 0 in 0.718s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:32 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aef91e58-3002-4188-a7cf-87dd36cf3986 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" returned: 0 in 0.898s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:32 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c is being set with open permissions: ugo+rw Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-40460aea-940f-44ad-91cc-c6b8109fa776" released by "delete_volume" :: held 1.918s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:32 devstack sudo[106971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c Jul 07 09:34:32 devstack sudo[106971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:32 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed" returned: 0 in 1.117s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:32 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed Jul 07 09:34:32 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Created reservations ['97e9064d-d781-4fa9-86c2-f8b1701a2522', '5fdc982d-cbbf-4565-960d-2bec7f630a41', '309bdb0e-6990-4c3d-95d4-719b2d14370c', '28d69e51-74dd-4fff-843a-dbcad037d4b1'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:32 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:32 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:33 devstack sudo[106971]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" returned: 0 in 0.788s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:33 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:33 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-cec87fbe-441a-4314-9c6a-4734df1e03ed" returned: 0 in 0.795s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:33 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-quobyte-cec87fbe-441a-4314-9c6a-4734df1e03ed" released by "delete_volume" :: held 1.968s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (8426f750-b1b8-4f55-9a8c-ea91d2e86e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1776b6b5-fa74-4c1f-96d5-4b8cf8171fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:33 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.759s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1776b6b5-fa74-4c1f-96d5-4b8cf8171fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624691862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175b5681-b69b-497b-88fd-49efce483195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:34Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dddc02-f1d0-4bde-9f28-4614e5e27122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21dddc02-f1d0-4bde-9f28-4614e5e27122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499662f2-5ade-44fa-b0e4-72e85b398e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (499662f2-5ade-44fa-b0e4-72e85b398e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '175b5681-b69b-497b-88fd-49efce483195', 'volume_name': 'volume-175b5681-b69b-497b-88fd-49efce483195', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d25fc5-019e-495a-bd8f-40cd90175f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05d25fc5-019e-495a-bd8f-40cd90175f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7db214e-0515-486c-95a4-df8f3b8fdb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:33 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Volume 175b5681-b69b-497b-88fd-49efce483195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-175b5681-b69b-497b-88fd-49efce483195', 'volume_size': 1} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f1be49ca-9fb8-42d0-9e44-d24c6bbcad6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-40460aea-940f-44ad-91cc-c6b8109fa776-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Created reservations ['5b2a0452-01fe-44fa-8e83-341a686f9e78', 'fe6a52e1-949a-43b8-926f-b9adab78a997', '3f77c6fc-5d53-42ae-acef-aea8e0c1dbc7', '751f0ccb-7642-4b5e-978d-93cd18788a4a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:33 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:33 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:34 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info" returned: 0 in 0.696s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:34 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info is being set with open permissions: ugo+rw Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:34 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info Jul 07 09:34:34 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:34 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.669s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Deleted volume successfully. Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4adbad50-acb3-4bf5-aad5-01ac7eb5c7ed tempest-CreateVolumesFromSourceVolumeTest-2068036940 None] Lock "cinder-cec87fbe-441a-4314-9c6a-4734df1e03ed-delete_volume" released by "delete_volume" :: held 2.985s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:34 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.info" returned: 0 in 0.654s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.226s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.204s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-624691862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=175b5681-b69b-497b-88fd-49efce483195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:34Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Creating volume 175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:34 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:35 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 1073741824 Jul 07 09:34:35 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a8999d4b-91a3-4306-b6fd-d6d4007a11de tempest-ProjectReaderTests-1538320467 None] Create snapshot completed successfully Jul 07 09:34:35 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 1073741824" returned: 0 in 0.881s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:35 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 Jul 07 09:34:35 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-ce6223c7-eae6-49fb-bb8c-50ab007d2e5c-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Lock "cinder-ce6223c7-eae6-49fb-bb8c-50ab007d2e5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-aef91e58-3002-4188-a7cf-87dd36cf3986" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-aef91e58-3002-4188-a7cf-87dd36cf3986" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Deleting offline snapshot ce6223c7-eae6-49fb-bb8c-50ab007d2e5c of volume aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] snapshot_file for this snap is: volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8980c0cc-e6fe-48c5-b357-39fde885a2b6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:36 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c Jul 07 09:34:36 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:36 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195" returned: 0 in 0.749s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.674s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7db214e-0515-486c-95a4-df8f3b8fdb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-175b5681-b69b-497b-88fd-49efce483195', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3282cad-7bd6-4f9a-97a2-643f73ed50cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:36 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Volume volume-175b5681-b69b-497b-88fd-49efce483195 (175b5681-b69b-497b-88fd-49efce483195): created successfully Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3282cad-7bd6-4f9a-97a2-643f73ed50cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:36 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (8426f750-b1b8-4f55-9a8c-ea91d2e86e25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-04050e6c-5a5c-46d4-ba04-364265cec591 tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:34:37 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" returned: 0 in 0.810s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aef91e58-3002-4188-a7cf-87dd36cf3986(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a52a20-7f8c-4752-8b43-fa04169c4bc6]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:37 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 Jul 07 09:34:37 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Flow 'volume_create_manager' (f46cb26d-80d1-492c-8848-f4556fe7c4d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e83dd7-5c37-4727-91b6-4d3a7c767837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e83dd7-5c37-4727-91b6-4d3a7c767837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d201645-8d2b-4859-a7ec-bafad68a2184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c7e1d7dd104beda0c07580673e761c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:38Z,use_quota=True,user_id='7a27381511eb47998eae4c0e7bfa8eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e75e4bd-ea29-415d-af9d-5ced4ccfa536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e75e4bd-ea29-415d-af9d-5ced4ccfa536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d848d0-9871-4ce1-93cb-31462987e6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d848d0-9871-4ce1-93cb-31462987e6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d201645-8d2b-4859-a7ec-bafad68a2184', 'volume_name': 'volume-8d201645-8d2b-4859-a7ec-bafad68a2184', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1416ac-942c-4f51-b75b-74b4775fab4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d1416ac-942c-4f51-b75b-74b4775fab4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17072219-214f-46d1-a192-51997afc40dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:37 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Volume 8d201645-8d2b-4859-a7ec-bafad68a2184: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d201645-8d2b-4859-a7ec-bafad68a2184', 'volume_size': 1} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d201645-8d2b-4859-a7ec-bafad68a2184,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c7e1d7dd104beda0c07580673e761c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:38Z,use_quota=True,user_id='7a27381511eb47998eae4c0e7bfa8eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Creating volume 8d201645-8d2b-4859-a7ec-bafad68a2184 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:37 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:37 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 1073741824 Jul 07 09:34:37 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:38 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986" returned: 0 in 0.823s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:38 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c Jul 07 09:34:38 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:38 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 1073741824" returned: 0 in 0.845s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:38 devstack sudo[107019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 Jul 07 09:34:38 devstack sudo[107019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:38 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" returned: 0 in 0.780s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:38 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c Jul 07 09:34:38 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:39 devstack sudo[107019]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184" returned: 0 in 0.625s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.392s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17072219-214f-46d1-a192-51997afc40dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d201645-8d2b-4859-a7ec-bafad68a2184', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af77891a-9b66-4e34-83b1-7d3b31d4090e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd of volume 175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:34:39 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Volume volume-8d201645-8d2b-4859-a7ec-bafad68a2184 (8d201645-8d2b-4859-a7ec-bafad68a2184): created successfully Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af77891a-9b66-4e34-83b1-7d3b31d4090e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Flow 'volume_create_manager' (f46cb26d-80d1-492c-8848-f4556fe7c4d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c2a122-cf56-4b0f-b182-5f470edc4b18]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:39 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-766be22f-d7f3-4cb3-a946-766e8c1a8769 tempest-CinderUnicodeTest-286394385 None] Created volume successfully. Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986.ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" returned: 0 in 0.685s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-ce6223c7-eae6-49fb-bb8c-50ab007d2e5c" released by "_delete_snapshot" :: held 3.193s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-aef91e58-3002-4188-a7cf-87dd36cf3986" released by "delete_snapshot" :: held 3.221s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Created reservations ['417a0d09-9f30-436f-8c9f-1ee393a1d999', 'e46ddef5-1f5e-478f-9190-b268536c0321', 'ff9c9d00-298f-4006-97eb-2f7ad871353a', 'cab23104-fbeb-4216-90ac-782c51df3e46'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:39 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 Jul 07 09:34:39 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Delete snapshot completed successfully. Jul 07 09:34:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-f93f88b5-080d-4312-b02e-584f953ef79d tempest-ProjectReaderTests-1538320467 None] Lock "cinder-ce6223c7-eae6-49fb-bb8c-50ab007d2e5c-delete_snapshot" released by "delete_snapshot" :: held 3.359s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:40 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195" returned: 0 in 0.806s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:40 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd 1G Jul 07 09:34:40 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Flow 'volume_create_manager' (c9ef5185-14ee-4348-9093-df24a614d8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f036b7c-f63a-43d1-ad8c-571860515d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f036b7c-f63a-43d1-ad8c-571860515d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-942230120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da5d375-4968-4d6c-a422-8610a3ce242b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c7e1d7dd104beda0c07580673e761c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:40Z,use_quota=True,user_id='7a27381511eb47998eae4c0e7bfa8eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a84bb5-40ff-4b1b-b269-c0761e4c3f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a84bb5-40ff-4b1b-b269-c0761e4c3f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f81a1a-63a5-49ae-90df-82901f6c77ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f81a1a-63a5-49ae-90df-82901f6c77ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0da5d375-4968-4d6c-a422-8610a3ce242b', 'volume_name': 'volume-0da5d375-4968-4d6c-a422-8610a3ce242b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4fe1ef-a272-453e-8d5f-7c03d5eec738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b4fe1ef-a272-453e-8d5f-7c03d5eec738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6405d19d-4223-4a6b-bf2c-a32a726c4bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:40 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Volume 0da5d375-4968-4d6c-a422-8610a3ce242b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0da5d375-4968-4d6c-a422-8610a3ce242b', 'volume_size': 1} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-aef91e58-3002-4188-a7cf-87dd36cf3986-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-aef91e58-3002-4188-a7cf-87dd36cf3986-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-aef91e58-3002-4188-a7cf-87dd36cf3986" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-aef91e58-3002-4188-a7cf-87dd36cf3986" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd9890b-e175-47ed-b9aa-86b28b591a40]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:40 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 Jul 07 09:34:40 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:41 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd 1G" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175b5681-b69b-497b-88fd-49efce483195 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:41 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175b5681-b69b-497b-88fd-49efce483195 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd Jul 07 09:34:41 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:41 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:41 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986 Jul 07 09:34:41 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:41 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-175b5681-b69b-497b-88fd-49efce483195 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" returned: 0 in 0.694s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:41 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd is being set with open permissions: ugo+rw Jul 07 09:34:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:41 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd Jul 07 09:34:41 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:42 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-aef91e58-3002-4188-a7cf-87dd36cf3986" returned: 0 in 0.635s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-aef91e58-3002-4188-a7cf-87dd36cf3986" released by "delete_volume" :: held 1.502s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Created reservations ['c42a0d2e-180b-446e-8039-a7db9521d36c', '54d03d78-6fea-4ce7-89b3-bd8a3d8459bf', 'f687f6d2-8397-4351-ac9a-1c0823d388c4', '089d0aaf-8941-40aa-87b5-cde7721bf362'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:42 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:42 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:42 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" returned: 0 in 0.705s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:42 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info Jul 07 09:34:42 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:43 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.743s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Deleted volume successfully. Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a9a129ed-4db1-4f91-b266-6bc3758184a1 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-aef91e58-3002-4188-a7cf-87dd36cf3986-delete_volume" released by "delete_volume" :: held 2.484s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:43 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (a89bc0d5-ad33-420f-8b59-5136838bc7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d058dd-6da3-49d9-9dea-156f828dbe5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info" returned: 0 in 0.716s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:43 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info is being set with open permissions: ugo+rw Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:43 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info Jul 07 09:34:43 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1d058dd-6da3-49d9-9dea-156f828dbe5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2003673706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269e25d1-8dfc-401c-9828-25876ad19727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:43Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c7bc59-a475-4fc9-944f-704fb3fbbe5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c7bc59-a475-4fc9-944f-704fb3fbbe5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bf87a5-7134-4097-9d4e-60eda8338edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37bf87a5-7134-4097-9d4e-60eda8338edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269e25d1-8dfc-401c-9828-25876ad19727', 'volume_name': 'volume-269e25d1-8dfc-401c-9828-25876ad19727', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06622c30-5d45-48bb-9ccd-634774640f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06622c30-5d45-48bb-9ccd-634774640f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9322caf3-98d5-493c-b83e-4d70b5d79c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:43 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Volume 269e25d1-8dfc-401c-9828-25876ad19727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269e25d1-8dfc-401c-9828-25876ad19727', 'volume_size': 1} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:43 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.info" returned: 0 in 0.611s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.510s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.489s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:40Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-942230120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0da5d375-4968-4d6c-a422-8610a3ce242b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02c7e1d7dd104beda0c07580673e761c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:40Z,use_quota=True,user_id='7a27381511eb47998eae4c0e7bfa8eff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Creating volume 0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:43 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:43 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b 1073741824 Jul 07 09:34:43 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:44 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-431a6fb3-2c28-4bc4-bd61-6004894528f8 tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Lock "cinder-ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-175b5681-b69b-497b-88fd-49efce483195" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-175b5681-b69b-497b-88fd-49efce483195" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd of volume 175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ceaddae-2b2e-4693-a2ab-8a8cb8057a8c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:44 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd Jul 07 09:34:44 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:44 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b 1073741824" returned: 0 in 0.853s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:44 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b Jul 07 09:34:44 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:45 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" returned: 0 in 0.786s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-175b5681-b69b-497b-88fd-49efce483195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1877a8e-e08b-4c14-bd82-2490af2dc097]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:45 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 Jul 07 09:34:45 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:45 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b" returned: 0 in 0.675s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] <== create_volume: return (1570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.139s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2003673706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269e25d1-8dfc-401c-9828-25876ad19727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:43Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Creating volume 269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:45 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:45 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 1073741824 Jul 07 09:34:45 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6405d19d-4223-4a6b-bf2c-a32a726c4bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0da5d375-4968-4d6c-a422-8610a3ce242b', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398abaae-d5dc-4ac9-a614-a6dcd275aa90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:45 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Volume volume-0da5d375-4968-4d6c-a422-8610a3ce242b (0da5d375-4968-4d6c-a422-8610a3ce242b): created successfully Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398abaae-d5dc-4ac9-a614-a6dcd275aa90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Flow 'volume_create_manager' (c9ef5185-14ee-4348-9093-df24a614d8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:45 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-28917a5c-ae50-4295-b483-edc34177ace9 tempest-CinderUnicodeTest-286394385 None] Created volume successfully. Jul 07 09:34:45 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195" returned: 0 in 0.782s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:46 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd Jul 07 09:34:46 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:46 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 1073741824" returned: 0 in 0.878s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:46 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 Jul 07 09:34:46 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:46 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" returned: 0 in 0.818s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:46 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd Jul 07 09:34:46 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:47 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727" returned: 0 in 0.724s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.651s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.181s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Creating offline snapshot 7471b258-8960-4fd4-a9df-141588102b08 of volume 0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9322caf3-98d5-493c-b83e-4d70b5d79c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269e25d1-8dfc-401c-9828-25876ad19727', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee1acf6-0e72-4228-b890-d4e5d9599098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4ddf82-d6fd-4b6a-b74e-cba68f8e7a2c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:47 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Volume volume-269e25d1-8dfc-401c-9828-25876ad19727 (269e25d1-8dfc-401c-9828-25876ad19727): created successfully Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eee1acf6-0e72-4228-b890-d4e5d9599098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (a89bc0d5-ad33-420f-8b59-5136838bc7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6c99484e-907f-4685-96e7-ea0f2407b3ba tempest-ProjectReaderTests-1538320467 None] Created volume successfully. Jul 07 09:34:47 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b Jul 07 09:34:47 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:47 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195.ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" returned: 0 in 0.671s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd" released by "_delete_snapshot" :: held 3.164s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-175b5681-b69b-497b-88fd-49efce483195" released by "delete_snapshot" :: held 3.187s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Created reservations ['0a01fcb6-1908-4153-943a-50bc16d4b455', '08de4aa4-12b6-4f32-b069-f1fbfa31d66a', '5e539fa7-a424-4b30-8b74-93c0265311e0', 'c9cb92f6-397e-4a47-9425-906c87742bea'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ee553ef0-1f3e-4ba3-96f2-41a2417762fa tempest-ProjectMemberTests-1478510747 None] Lock "cinder-ecb5ced8-4232-4c7d-91b4-bdad7b2a9cbd-delete_snapshot" released by "delete_snapshot" :: held 3.372s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:48 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b" returned: 0 in 0.848s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:48 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 1G Jul 07 09:34:48 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-175b5681-b69b-497b-88fd-49efce483195-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-175b5681-b69b-497b-88fd-49efce483195-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-175b5681-b69b-497b-88fd-49efce483195" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-175b5681-b69b-497b-88fd-49efce483195" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e68baf0-fe8c-4f86-9fed-b44fcf62c45d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:48 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 Jul 07 09:34:48 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:48 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 1G" returned: 0 in 0.832s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da5d375-4968-4d6c-a422-8610a3ce242b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:48 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da5d375-4968-4d6c-a422-8610a3ce242b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 Jul 07 09:34:48 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:49 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195" returned: 0 in 0.765s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:49 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195 Jul 07 09:34:49 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:49 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0da5d375-4968-4d6c-a422-8610a3ce242b -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08" returned: 0 in 0.697s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:49 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 is being set with open permissions: ugo+rw Jul 07 09:34:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:49 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 Jul 07 09:34:49 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:50 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-175b5681-b69b-497b-88fd-49efce483195" returned: 0 in 0.666s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-175b5681-b69b-497b-88fd-49efce483195" released by "delete_volume" :: held 1.493s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:50 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08" returned: 0 in 0.629s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Created reservations ['f4060a58-c0a8-40de-b87f-d6eea06022b0', '805383b7-2842-450d-b5e6-9b1aed09eb47', '633d98de-7928-4c74-9086-34d58e343be1', 'e197de6e-685f-4356-80d0-db77ea365977'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:50 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info Jul 07 09:34:50 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:50 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:50 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:50 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:50 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info is being set with open permissions: ugo+rw Jul 07 09:34:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:50 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info Jul 07 09:34:50 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:51 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.690s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-6ba9c829-d59c-482b-b331-4e82a06f0a2c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-175b5681-b69b-497b-88fd-49efce483195-delete_volume" released by "delete_volume" :: held 2.426s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (c02c59e0-1ac8-45c3-a3a9-a2f404c052f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c627513d-28ea-4b86-a236-f9fb14c919a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c627513d-28ea-4b86-a236-f9fb14c919a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526245332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0683bbc-1c40-4b8b-9707-69ca13ae4d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:51Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c92d4b-5eeb-4516-847a-ade0ffd13224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0c92d4b-5eeb-4516-847a-ade0ffd13224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc4479c-c439-4a7e-98e1-6034479bec0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbc4479c-c439-4a7e-98e1-6034479bec0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0683bbc-1c40-4b8b-9707-69ca13ae4d9a', 'volume_name': 'volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0562fdca-890e-4c41-8c51-c6a602f0c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0562fdca-890e-4c41-8c51-c6a602f0c949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b49a6f3-f380-4ed1-8db3-26e97b56f99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:51 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Volume b0683bbc-1c40-4b8b-9707-69ca13ae4d9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a', 'volume_size': 1} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:51 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.info" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.456s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.945s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Creating offline snapshot 5f163922-e07a-4e91-a47d-d28acc8797ba of volume 269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:34:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-b63e2cc8-4415-4e05-b88d-32ee632cc24a tempest-CinderUnicodeTest-286394385 None] Create snapshot completed successfully Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe7340b-03cb-422e-97e0-474d4018af11]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:51 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 Jul 07 09:34:51 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-7471b258-8960-4fd4-a9df-141588102b08-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-7471b258-8960-4fd4-a9df-141588102b08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-quobyte-0da5d375-4968-4d6c-a422-8610a3ce242b" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-0da5d375-4968-4d6c-a422-8610a3ce242b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-quobyte-7471b258-8960-4fd4-a9df-141588102b08" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-7471b258-8960-4fd4-a9df-141588102b08" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Deleting offline snapshot 7471b258-8960-4fd4-a9df-141588102b08 of volume 0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] snapshot_file for this snap is: volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c7c269-ea7b-4127-a9cc-cd36f67cd677]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:52 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:52 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 Jul 07 09:34:52 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:52 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba 1G Jul 07 09:34:52 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:53 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0da5d375-4968-4d6c-a422-8610a3ce242b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69def70-ab17-4480-b7b2-2352595e5a31]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:53 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:53 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba 1G" returned: 0 in 0.837s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:53 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269e25d1-8dfc-401c-9828-25876ad19727 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:53 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269e25d1-8dfc-401c-9828-25876ad19727 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba Jul 07 09:34:53 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:53 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b" returned: 0 in 0.787s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:53 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269e25d1-8dfc-401c-9828-25876ad19727 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba" returned: 0 in 0.682s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:54 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba is being set with open permissions: ugo+rw Jul 07 09:34:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:54 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 Jul 07 09:34:54 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:54 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba Jul 07 09:34:54 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:54 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba" returned: 0 in 0.653s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:54 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info Jul 07 09:34:54 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:54 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08" returned: 0 in 0.734s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:54 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08 Jul 07 09:34:54 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:55 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info" returned: 0 in 0.688s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:55 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info is being set with open permissions: ugo+rw Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:55 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b.7471b258-8960-4fd4-a9df-141588102b08" returned: 0 in 0.663s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:55 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info Jul 07 09:34:55 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-7471b258-8960-4fd4-a9df-141588102b08" released by "_delete_snapshot" :: held 3.112s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-0da5d375-4968-4d6c-a422-8610a3ce242b" released by "delete_snapshot" :: held 3.136s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Created reservations ['e53e4f04-94ed-4c8b-a492-376c2be4078b', 'eabfa0cc-cb18-442b-b67a-51b47d5adb97', '84fb717d-137e-41ef-bf4a-d669915f3ac4', '19d42c92-fed7-4b63-bdc3-eecd25804591'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:55 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Delete snapshot completed successfully. Jul 07 09:34:55 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-60218261-1dee-45e8-8618-127cfd94de48 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-7471b258-8960-4fd4-a9df-141588102b08-delete_snapshot" released by "delete_snapshot" :: held 3.279s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:56 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.info" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.389s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.605s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:34:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1526245332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0683bbc-1c40-4b8b-9707-69ca13ae4d9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:34:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:34:51Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Creating volume b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:34:56 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:56 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a 1073741824 Jul 07 09:34:56 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-480e1ec8-6dc7-4fc0-a5a4-033a8837613b tempest-ProjectReaderTests-1538320467 None] Create snapshot completed successfully Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-0da5d375-4968-4d6c-a422-8610a3ce242b-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-0da5d375-4968-4d6c-a422-8610a3ce242b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-quobyte-0da5d375-4968-4d6c-a422-8610a3ce242b" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-0da5d375-4968-4d6c-a422-8610a3ce242b" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7731db16-5c34-4d21-adaf-d5a95d66be8f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:56 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b Jul 07 09:34:56 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:56 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a 1073741824" returned: 0 in 0.837s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:56 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a Jul 07 09:34:56 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-5f163922-e07a-4e91-a47d-d28acc8797ba-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-5f163922-e07a-4e91-a47d-d28acc8797ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-269e25d1-8dfc-401c-9828-25876ad19727" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-269e25d1-8dfc-401c-9828-25876ad19727" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-5f163922-e07a-4e91-a47d-d28acc8797ba" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-5f163922-e07a-4e91-a47d-d28acc8797ba" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Deleting offline snapshot 5f163922-e07a-4e91-a47d-d28acc8797ba of volume 269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] snapshot_file for this snap is: volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84eeee5-254f-40a7-8311-c525d452f49d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:57 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba Jul 07 09:34:57 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:57 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:57 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b Jul 07 09:34:57 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:57 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b49a6f3-f380-4ed1-8db3-26e97b56f99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3c07ad-dbd9-4c48-9613-da9d5c3d4cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:34:57 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Volume volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a (b0683bbc-1c40-4b8b-9707-69ca13ae4d9a): created successfully Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3c07ad-dbd9-4c48-9613-da9d5c3d4cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (c02c59e0-1ac8-45c3-a3a9-a2f404c052f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:34:57 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-843e6bfe-5cdf-4585-80eb-736e23b9039f tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:34:57 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba" returned: 0 in 0.784s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269e25d1-8dfc-401c-9828-25876ad19727(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[478e4d7c-e922-4f5d-a382-36758a8a6125]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:58 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 Jul 07 09:34:58 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:58 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0da5d375-4968-4d6c-a422-8610a3ce242b" returned: 0 in 0.712s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-0da5d375-4968-4d6c-a422-8610a3ce242b" released by "delete_volume" :: held 1.552s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Created reservations ['f8f24d4c-29f2-481d-853a-e4402b279763', '0b1f39f4-f702-4476-8043-953159ded88d', '7712bd58-a133-4f70-8c51-334368ba3d33', '43b45fe6-0140-499a-b5b4-71679c047694'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:58 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:34:58 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:58 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727" returned: 0 in 0.788s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:58 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba Jul 07 09:34:58 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-8d201645-8d2b-4859-a7ec-bafad68a2184-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-8d201645-8d2b-4859-a7ec-bafad68a2184-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "cinder-quobyte-8d201645-8d2b-4859-a7ec-bafad68a2184" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:34:58 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-8d201645-8d2b-4859-a7ec-bafad68a2184" acquired by "delete_volume" :: waited 0.027s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:34:58 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3210c62d-1f8b-4696-8474-1afc05159a2c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.754s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:34:59 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Deleted volume successfully. Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 of volume b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-590a4c4c-761e-4b9a-b10d-d188c3946b10 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-0da5d375-4968-4d6c-a422-8610a3ce242b-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[888a256f-fa77-45b9-9d1b-0df92007ab41]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:59 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 Jul 07 09:34:59 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:59 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a Jul 07 09:34:59 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:59 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba" returned: 0 in 0.894s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:59 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba Jul 07 09:34:59 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:59 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184" returned: 0 in 0.788s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:59 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184 Jul 07 09:34:59 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:34:59 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:34:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:34:59 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 1G Jul 07 09:34:59 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:00 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727.5f163922-e07a-4e91-a47d-d28acc8797ba" returned: 0 in 0.665s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-5f163922-e07a-4e91-a47d-d28acc8797ba" released by "_delete_snapshot" :: held 3.226s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-269e25d1-8dfc-401c-9828-25876ad19727" released by "delete_snapshot" :: held 3.252s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Created reservations ['8449f36e-3c03-425f-beaf-e36f6ac55a93', '5db4495c-3b44-4f89-87e7-8020b5d442d0', 'aec80ce4-12de-4290-840b-f05b56db6831', 'f4f33cfb-b188-46a5-8cd9-bb3cdbfa8c3c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:00 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Delete snapshot completed successfully. Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-163ae7a0-f3d3-4150-a540-da84c68bdb78 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-5f163922-e07a-4e91-a47d-d28acc8797ba-delete_snapshot" released by "delete_snapshot" :: held 3.403s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:00 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-8d201645-8d2b-4859-a7ec-bafad68a2184" returned: 0 in 0.735s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-quobyte-8d201645-8d2b-4859-a7ec-bafad68a2184" released by "delete_volume" :: held 1.587s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Created reservations ['14e833da-7d32-442e-886c-0f5d82bea057', 'cb644d82-f4e0-4243-989a-e3ff5de0c59d', '8bea25b7-de94-44b5-aae0-54bd13a98feb', '68d6fc50-8d80-4db5-956f-f659a6e2fa17'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:00 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:00 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:00 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 1G" returned: 0 in 0.891s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:00 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 Jul 07 09:35:00 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-269e25d1-8dfc-401c-9828-25876ad19727-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:01 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.702s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Deleted volume successfully. Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-269e25d1-8dfc-401c-9828-25876ad19727-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-ed1f59f6-1799-47c5-a63b-2d7df12b2479 tempest-CinderUnicodeTest-286394385 None] Lock "cinder-8d201645-8d2b-4859-a7ec-bafad68a2184-delete_volume" released by "delete_volume" :: held 2.560s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-269e25d1-8dfc-401c-9828-25876ad19727" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-269e25d1-8dfc-401c-9828-25876ad19727" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd39717-619b-4f7b-8f4a-ad374b55d1e7]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:01 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" returned: 0 in 0.825s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:01 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 is being set with open permissions: ugo+rw Jul 07 09:35:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:01 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 Jul 07 09:35:01 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:01 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 Jul 07 09:35:01 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:02 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" returned: 0 in 0.725s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:02 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727" returned: 0 in 0.839s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:02 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info Jul 07 09:35:02 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:02 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727 Jul 07 09:35:02 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:03 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info" returned: 0 in 0.667s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:03 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info is being set with open permissions: ugo+rw Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:03 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info Jul 07 09:35:03 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:03 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-269e25d1-8dfc-401c-9828-25876ad19727" returned: 0 in 0.718s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-269e25d1-8dfc-401c-9828-25876ad19727" released by "delete_volume" :: held 1.638s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Created reservations ['b2e51675-8e0f-46c3-8dbf-62ca4a40cf48', 'cf537474-a91a-41e5-96eb-0037973ec725', '297bbc34-904c-4a9f-a226-91bc72d5cbe1', '3f76ff45-6b42-483b-ab43-be9eb43c8ddc'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:03 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:03 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:03 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.info" returned: 0 in 0.688s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.684s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-634249fa-a4a2-4e10-b54c-7f38b42e367c tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:35:03 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.708s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:03 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Deleted volume successfully. Jul 07 09:35:03 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fbea5418-d994-4822-bb99-589584fcaba5 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-269e25d1-8dfc-401c-9828-25876ad19727-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (45fc2aed-a152-49c2-a472-5476ef317579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e682daf0-66c0-4904-9f41-9115254d3341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e682daf0-66c0-4904-9f41-9115254d3341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813099522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5feb3dd-200a-46c5-8f02-5d2f5abc0f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:04Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44f1ce1-2554-404b-91c4-5ac9e78f8dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e44f1ce1-2554-404b-91c4-5ac9e78f8dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0485a55e-1407-4648-9329-04e6532f3661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0485a55e-1407-4648-9329-04e6532f3661) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5feb3dd-200a-46c5-8f02-5d2f5abc0f82', 'volume_name': 'volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78aa4219-5eec-4264-b18b-2a3bc7a1d250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78aa4219-5eec-4264-b18b-2a3bc7a1d250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c61306-55dc-40ee-91f2-5105cc516d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:04 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Volume e5feb3dd-200a-46c5-8f02-5d2f5abc0f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82', 'volume_size': 1} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1813099522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5feb3dd-200a-46c5-8f02-5d2f5abc0f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:04Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Creating volume e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:04 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:04 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 1073741824 Jul 07 09:35:04 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 of volume b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b471042d-9ccf-44fa-b82f-ba6ddf5e7169]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:04 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 Jul 07 09:35:04 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:05 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 1073741824" returned: 0 in 0.864s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:05 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 Jul 07 09:35:05 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:05 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" returned: 0 in 0.802s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2dca615-64f9-4806-8526-0346eabe4420]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:05 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a Jul 07 09:35:05 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:05 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" returned: 0 in 0.711s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] <== create_volume: return (1629ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2c61306-55dc-40ee-91f2-5105cc516d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aac9dbb-44bf-4ede-8209-96e0991a2399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:05 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Volume volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 (e5feb3dd-200a-46c5-8f02-5d2f5abc0f82): created successfully Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aac9dbb-44bf-4ede-8209-96e0991a2399) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:05 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (45fc2aed-a152-49c2-a472-5476ef317579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:05 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a3a4022b-8ee4-4d16-90fd-17d42a9d3a50 tempest-ProjectReaderTests-1538320467 None] Created volume successfully. Jul 07 09:35:06 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" returned: 0 in 0.831s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:06 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 Jul 07 09:35:06 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Creating offline snapshot 2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 of volume e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[497e254c-0b8e-4215-8f0a-5ed3b927bcaf]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:06 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 Jul 07 09:35:06 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:06 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" returned: 0 in 0.760s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:06 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7 Jul 07 09:35:06 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:07 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:07 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 1G Jul 07 09:35:07 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:07 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a.ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" returned: 0 in 0.723s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7" released by "_delete_snapshot" :: held 3.234s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" released by "delete_snapshot" :: held 3.257s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Created reservations ['0fdfd34e-a293-4a51-b8b8-b7c83a93bd8a', '98b29ea5-38f5-4a14-a88d-6e5f00f04d65', '32bd3c89-c2c2-4e00-93e9-1f4ed52efa67', '985d4860-8bcb-4833-80bb-3c66b56b3549'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:07 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:35:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-47e371a8-32e1-4f47-aaae-a9446ca9e387 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-ec0427b9-d03e-41c2-a0ff-8ffea8c3ddf7-delete_snapshot" released by "delete_snapshot" :: held 3.424s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:08 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 1G" returned: 0 in 0.897s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:08 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 Jul 07 09:35:08 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Lock "cinder-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8407c8a-d891-4b1d-badc-96d14d7bac6d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:08 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:08 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 is being set with open permissions: ugo+rw Jul 07 09:35:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:08 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a Jul 07 09:35:08 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:08 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 Jul 07 09:35:08 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:09 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" returned: 0 in 0.641s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:09 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=150,cinder:INSERT=59,cinder:UPDATE=194,cinder:DELETE=20 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:35:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:09 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" returned: 0 in 0.794s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:09 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info Jul 07 09:35:09 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:09 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a Jul 07 09:35:09 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:10 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:10 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info" returned: 0 in 0.723s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:10 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info is being set with open permissions: ugo+rw Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:10 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a" released by "delete_volume" :: held 1.563s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:10 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:INSERT=48,cinder:UPDATE=213,cinder:SELECT=147,cinder:DELETE=14 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Created reservations ['a40b89d3-ef6b-476f-bc72-8a176456622e', '8b5e9531-a607-4b61-a854-62173cd7a851', '74bcea2e-e36c-48c4-b0ef-b84f5f6d0a66', 'f709fe0d-c168-48f1-bbda-296a3ff1ce9c'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:10 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:10 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:10 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.info" returned: 0 in 0.746s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.592s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2481db7b-1e62-47fb-a416-4d5e59c02d85 tempest-ProjectReaderTests-1538320467 None] Create snapshot completed successfully Jul 07 09:35:11 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.794s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:11 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3be5f973-f203-475b-9315-e422a77727da tempest-ProjectMemberTests-1478510747 None] Lock "cinder-b0683bbc-1c40-4b8b-9707-69ca13ae4d9a-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (f9b5609b-0a16-4545-b3c2-5e6e25f0bc0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19ac289-ea57-4fb9-9c6c-7f6c85594d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19ac289-ea57-4fb9-9c6c-7f6c85594d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2054555604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6195679b-394e-4b9d-97fb-aede831bc0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:11Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1320bcd-63c4-4323-8fcf-f209bad8abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1320bcd-63c4-4323-8fcf-f209bad8abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d816fb-af6a-4532-ae5e-29020d593a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39d816fb-af6a-4532-ae5e-29020d593a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6195679b-394e-4b9d-97fb-aede831bc0bd', 'volume_name': 'volume-6195679b-394e-4b9d-97fb-aede831bc0bd', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d99286-bc2f-46b8-93d9-58f67e887041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d99286-bc2f-46b8-93d9-58f67e887041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d13445-2dfe-45a9-8ab3-0dfc74ba9c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Volume 6195679b-394e-4b9d-97fb-aede831bc0bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6195679b-394e-4b9d-97fb-aede831bc0bd', 'volume_size': 1} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2054555604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6195679b-394e-4b9d-97fb-aede831bc0bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:11Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Creating volume 6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:11 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd 1073741824 Jul 07 09:35:11 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-2584d9f6-c59c-4a6f-9627-cd6ae578c8b8-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-2584d9f6-c59c-4a6f-9627-cd6ae578c8b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Deleting offline snapshot 2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 of volume e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] snapshot_file for this snap is: volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb8aab4-93d7-4444-a95c-ce1530987afd]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:11 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 Jul 07 09:35:11 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:12 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd 1073741824" returned: 0 in 0.810s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:12 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd Jul 07 09:35:12 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:12 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6301a769-5f7b-41f8-a159-42d8a17e3116]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:12 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 Jul 07 09:35:12 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:12 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd" returned: 0 in 0.661s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79d13445-2dfe-45a9-8ab3-0dfc74ba9c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6195679b-394e-4b9d-97fb-aede831bc0bd', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462464d1-1243-4580-8cbc-0eaf724fe9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Volume volume-6195679b-394e-4b9d-97fb-aede831bc0bd (6195679b-394e-4b9d-97fb-aede831bc0bd): created successfully Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (462464d1-1243-4580-8cbc-0eaf724fe9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (f9b5609b-0a16-4545-b3c2-5e6e25f0bc0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:13 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4852d572-3f8e-4492-976d-c0fdbf64c652 tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:35:13 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" returned: 0 in 0.771s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:13 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 Jul 07 09:35:13 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot 19c02d80-8f8e-46b2-846c-66f872abd6d2 of volume 6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7bccda3-911d-44f0-b18c-aa059156d48b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:13 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd Jul 07 09:35:13 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:14 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:14 devstack sudo[107403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8 Jul 07 09:35:14 devstack sudo[107403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:14 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd" returned: 0 in 0.784s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:14 devstack sudo[107408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 1G Jul 07 09:35:14 devstack sudo[107408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:14 devstack sudo[107403]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82.2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" returned: 0 in 0.683s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-2584d9f6-c59c-4a6f-9627-cd6ae578c8b8" released by "_delete_snapshot" :: held 3.065s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" released by "delete_snapshot" :: held 3.090s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Created reservations ['55482e06-de9f-406b-93f9-90f053a4542c', '671c58e8-ba6c-497e-9787-79d11b970614', '6f22965f-8075-434c-908f-2ecba5331596', '802ad6ea-ceea-47de-9196-43ffee555b29'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:14 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Delete snapshot completed successfully. Jul 07 09:35:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-af666a87-13d4-47d9-937d-687978847a30 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-2584d9f6-c59c-4a6f-9627-cd6ae578c8b8-delete_snapshot" released by "delete_snapshot" :: held 3.223s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:15 devstack sudo[107408]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 1G" returned: 0 in 0.788s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6195679b-394e-4b9d-97fb-aede831bc0bd -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:15 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6195679b-394e-4b9d-97fb-aede831bc0bd -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 Jul 07 09:35:15 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:15 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6195679b-394e-4b9d-97fb-aede831bc0bd -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2" returned: 0 in 0.662s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:15 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 is being set with open permissions: ugo+rw Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:15 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 Jul 07 09:35:15 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Lock "cinder-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:16 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[91cd6368-3559-48a3-9c1d-6883e509ef5f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:16 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 Jul 07 09:35:16 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:16 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:16 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info Jul 07 09:35:16 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:16 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:16 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82 Jul 07 09:35:16 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:17 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info" returned: 0 in 0.696s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:17 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info is being set with open permissions: ugo+rw Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:17 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info Jul 07 09:35:17 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:17 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" returned: 0 in 0.662s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82" released by "delete_volume" :: held 1.532s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Created reservations ['e5d973b0-44b4-4d26-ae13-d9699fec325f', 'e49f20ba-de1f-496c-b017-d59a1d954a73', '534f2e0a-1e1f-41fd-aa49-ea5322626158', '2b91d728-5e93-4e0e-ac03-740c1d291455'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:17 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:17 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:17 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.info" returned: 0 in 0.643s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.353s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e19ce21b-4bc1-4f25-8553-94a14e82321c tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:35:18 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.665s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Deleted volume successfully. Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3c90f29d-77bd-4714-b47c-c9c3eca33e8e tempest-ProjectReaderTests-1538320467 None] Lock "cinder-e5feb3dd-200a-46c5-8f02-5d2f5abc0f82-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (3ec3caef-eb48-4a95-b9a0-e59d9401059d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aa73d2-dff9-416e-a02f-f3eb9f67ad01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6aa73d2-dff9-416e-a02f-f3eb9f67ad01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645397082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097d0e8b-e198-4558-a0e4-10b209ccc934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:19Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6363dfb0-25ab-4bb2-bf06-76c75a4b5be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6363dfb0-25ab-4bb2-bf06-76c75a4b5be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07866398-c28e-42d0-9795-def3cfd1333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07866398-c28e-42d0-9795-def3cfd1333c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '097d0e8b-e198-4558-a0e4-10b209ccc934', 'volume_name': 'volume-097d0e8b-e198-4558-a0e4-10b209ccc934', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40976b50-9e93-4438-b24c-e8d86f0634c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40976b50-9e93-4438-b24c-e8d86f0634c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28461e6c-9aa5-428f-9bc1-55fd7545c7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Volume 097d0e8b-e198-4558-a0e4-10b209ccc934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-097d0e8b-e198-4558-a0e4-10b209ccc934', 'volume_size': 1} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645397082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=097d0e8b-e198-4558-a0e4-10b209ccc934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:19Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Creating volume 097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:18 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:18 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 1073741824 Jul 07 09:35:18 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-19c02d80-8f8e-46b2-846c-66f872abd6d2-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-19c02d80-8f8e-46b2-846c-66f872abd6d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-6195679b-394e-4b9d-97fb-aede831bc0bd" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-6195679b-394e-4b9d-97fb-aede831bc0bd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-19c02d80-8f8e-46b2-846c-66f872abd6d2" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-19c02d80-8f8e-46b2-846c-66f872abd6d2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot 19c02d80-8f8e-46b2-846c-66f872abd6d2 of volume 6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceffd4a-32a6-4c57-b3a9-7cc22a226c9b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:19 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 Jul 07 09:35:19 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:19 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 1073741824" returned: 0 in 0.818s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:19 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 Jul 07 09:35:19 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:19 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6195679b-394e-4b9d-97fb-aede831bc0bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd5cb1c-d5d3-4b9d-90e6-3105212ddaa4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:19 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd Jul 07 09:35:19 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:20 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934" returned: 0 in 0.656s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28461e6c-9aa5-428f-9bc1-55fd7545c7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-097d0e8b-e198-4558-a0e4-10b209ccc934', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214d27ad-4f0c-49cb-bce8-08139864936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:20 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Volume volume-097d0e8b-e198-4558-a0e4-10b209ccc934 (097d0e8b-e198-4558-a0e4-10b209ccc934): created successfully Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (214d27ad-4f0c-49cb-bce8-08139864936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (3ec3caef-eb48-4a95-b9a0-e59d9401059d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c82b7da9-dab8-4673-aa98-832405ff074d tempest-ProjectReaderTests-1538320467 None] Created volume successfully. Jul 07 09:35:20 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:20 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 Jul 07 09:35:20 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Creating offline snapshot 478293ed-bcdb-4fd9-b054-a6acb26af81d of volume 097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6988e34c-2540-4645-9927-a3fe310b8c34]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:21 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 Jul 07 09:35:21 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:21 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2" returned: 0 in 0.735s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:21 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2 Jul 07 09:35:21 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:21 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934" returned: 0 in 0.746s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:21 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d 1G Jul 07 09:35:21 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:21 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd.19c02d80-8f8e-46b2-846c-66f872abd6d2" returned: 0 in 0.650s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-19c02d80-8f8e-46b2-846c-66f872abd6d2" released by "_delete_snapshot" :: held 3.088s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-6195679b-394e-4b9d-97fb-aede831bc0bd" released by "delete_snapshot" :: held 3.117s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:22 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Created reservations ['ee89bd1b-1d1e-4a5d-8e2c-2c3d64a27151', 'e55a7954-4542-4331-95f9-b230df9443e5', 'f0a51173-a447-4836-9d84-e041f798def0', 'cfbd4e5e-8a25-4741-8fd1-ac615d0769c4'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:22 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:35:22 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a1a3a721-4fc5-4b8b-bdd9-ac7ed60501d2 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-19c02d80-8f8e-46b2-846c-66f872abd6d2-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:22 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d 1G" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097d0e8b-e198-4558-a0e4-10b209ccc934 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:22 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097d0e8b-e198-4558-a0e4-10b209ccc934 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d Jul 07 09:35:22 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-6195679b-394e-4b9d-97fb-aede831bc0bd-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-6195679b-394e-4b9d-97fb-aede831bc0bd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-6195679b-394e-4b9d-97fb-aede831bc0bd" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-6195679b-394e-4b9d-97fb-aede831bc0bd" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d3123c-d334-4d29-a721-48ffef9345c5]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:23 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-097d0e8b-e198-4558-a0e4-10b209ccc934 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d" returned: 0 in 0.729s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:23 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d is being set with open permissions: ugo+rw Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:23 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d Jul 07 09:35:23 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:23 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd Jul 07 09:35:23 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:23 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d" returned: 0 in 0.642s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:23 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info Jul 07 09:35:23 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:23 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd" returned: 0 in 0.784s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:23 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd Jul 07 09:35:23 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:24 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info" returned: 0 in 0.674s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:24 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info is being set with open permissions: ugo+rw Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:24 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info Jul 07 09:35:24 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:24 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-6195679b-394e-4b9d-97fb-aede831bc0bd" returned: 0 in 0.640s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-6195679b-394e-4b9d-97fb-aede831bc0bd" released by "delete_volume" :: held 1.484s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Created reservations ['411fe887-a03d-482a-8245-77a8d1e849d6', '1d3c4b7f-dc36-4c43-baa3-0f2db8e2cb47', '858375a7-3e68-46e7-aa20-586df05703cd', '0bf3c1f2-159a-44cd-b9b1-b180ed65691a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:24 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:24 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:25 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.info" returned: 0 in 0.681s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.339s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-822e5dd2-951c-4ce4-9e35-b68c2587bd93 tempest-ProjectReaderTests-1538320467 None] Create snapshot completed successfully Jul 07 09:35:25 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.671s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:25 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-198b9c8d-0318-4457-b49a-cb8b81ce4ac7 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-6195679b-394e-4b9d-97fb-aede831bc0bd-delete_volume" released by "delete_volume" :: held 2.362s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (52385984-55d1-44dd-8546-9d4934cfaa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdb04f0-c5f7-4ece-b865-8c8c30a46ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fdb04f0-c5f7-4ece-b865-8c8c30a46ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667068041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:26Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37998b1d-23cd-487a-add8-00e37b8a1b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37998b1d-23cd-487a-add8-00e37b8a1b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4ac7f6-e68f-402d-9581-e25a231356f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4ac7f6-e68f-402d-9581-e25a231356f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4', 'volume_name': 'volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ca3e6d-1902-4ad1-86c9-685b88df880c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7ca3e6d-1902-4ad1-86c9-685b88df880c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c5c7d-c077-41e8-8cea-eebaab0fbb6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:25 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Volume 60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4', 'volume_size': 1} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1667068041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:26Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Creating volume 60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:25 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:25 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 1073741824 Jul 07 09:35:25 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-478293ed-bcdb-4fd9-b054-a6acb26af81d-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-478293ed-bcdb-4fd9-b054-a6acb26af81d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-097d0e8b-e198-4558-a0e4-10b209ccc934" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-097d0e8b-e198-4558-a0e4-10b209ccc934" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-478293ed-bcdb-4fd9-b054-a6acb26af81d" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-478293ed-bcdb-4fd9-b054-a6acb26af81d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Deleting offline snapshot 478293ed-bcdb-4fd9-b054-a6acb26af81d of volume 097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] snapshot_file for this snap is: volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479158b-5c72-4209-9cab-999bb1be8053]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:26 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d Jul 07 09:35:26 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:26 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 1073741824" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:26 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 Jul 07 09:35:26 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:26 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d" returned: 0 in 0.789s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-097d0e8b-e198-4558-a0e4-10b209ccc934(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:27 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:27 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c34ef3-0d34-4336-85bf-12b973f95c53]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:27 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 Jul 07 09:35:27 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:27 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" returned: 0 in 0.643s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c5c7d-c077-41e8-8cea-eebaab0fbb6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc2434d-3619-45fe-8e8b-06274cdfba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:27 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Volume volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 (60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4): created successfully Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fc2434d-3619-45fe-8e8b-06274cdfba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (52385984-55d1-44dd-8546-9d4934cfaa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-41446a06-5a78-422c-935a-7960ece05e04 tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:35:27 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.661s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:35:27 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:27 devstack sudo[107524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d Jul 07 09:35:27 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot a57725e9-de09-4fd1-a13d-882168664687 of volume 60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefa7555-df2a-4134-a223-3d4bdef5805f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:28 devstack sudo[107526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 Jul 07 09:35:28 devstack sudo[107526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:28 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d" returned: 0 in 0.744s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:28 devstack sudo[107531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d Jul 07 09:35:28 devstack sudo[107531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:28 devstack sudo[107526]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:28 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 1G Jul 07 09:35:28 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:29 devstack sudo[107531]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934.478293ed-bcdb-4fd9-b054-a6acb26af81d" returned: 0 in 0.650s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-478293ed-bcdb-4fd9-b054-a6acb26af81d" released by "_delete_snapshot" :: held 3.058s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-097d0e8b-e198-4558-a0e4-10b209ccc934" released by "delete_snapshot" :: held 3.085s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Created reservations ['dc547b55-f71d-4e56-a7b0-755e2300468c', '68919bc8-85b4-4413-a821-f7129c8a4a36', '2e612465-bbb0-402c-bae9-0908bbe4f2de', 'bc5d5988-3090-4591-b5ff-1cb368488f75'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:29 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Delete snapshot completed successfully. Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2f25a464-c79b-4b52-8fbb-23cf79adcfc9 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-478293ed-bcdb-4fd9-b054-a6acb26af81d-delete_snapshot" released by "delete_snapshot" :: held 3.240s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:29 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 1G" returned: 0 in 0.835s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:29 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 Jul 07 09:35:29 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:30 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687" returned: 0 in 0.682s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:30 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 is being set with open permissions: ugo+rw Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:30 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 Jul 07 09:35:30 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-097d0e8b-e198-4558-a0e4-10b209ccc934-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Lock "cinder-097d0e8b-e198-4558-a0e4-10b209ccc934-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-097d0e8b-e198-4558-a0e4-10b209ccc934" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-097d0e8b-e198-4558-a0e4-10b209ccc934" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d0aecc-d994-4019-bc7b-c16172451b53]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:30 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 Jul 07 09:35:30 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:30 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:31 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info Jul 07 09:35:31 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:31 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934" returned: 0 in 0.773s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:31 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934 Jul 07 09:35:31 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:31 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info" returned: 0 in 0.639s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:31 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info is being set with open permissions: ugo+rw Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:31 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info Jul 07 09:35:31 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:31 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-097d0e8b-e198-4558-a0e4-10b209ccc934" returned: 0 in 0.628s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-097d0e8b-e198-4558-a0e4-10b209ccc934" released by "delete_volume" :: held 1.460s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:31 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Created reservations ['3cc734b0-9c5c-4d7b-b942-76f3fddc9b4a', '9e04d13a-ec73-40f6-9838-caf47e519c8e', '9f91ff50-6d83-4514-afa0-c3ce04e77dd6', '2f2f87d6-e182-4340-9185-0c6f9b59e8f5'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:32 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:32 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:32 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.info" returned: 0 in 0.637s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.340s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-e173fcd1-c659-41dc-ad48-b27cecef95ac tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:35:32 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.644s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Deleted volume successfully. Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-c666069e-7f95-4653-a98d-98349f87327b tempest-ProjectReaderTests-1538320467 None] Lock "cinder-097d0e8b-e198-4558-a0e4-10b209ccc934-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (ce043c05-544e-4a2b-bf0a-007a715d6f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:32 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a17ba5-fdd6-403b-b3bd-6d521258e9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a17ba5-fdd6-403b-b3bd-6d521258e9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253352362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad38710a-c39f-4544-b12f-8485cc69c96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:33Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cae0f37-1c48-43e7-94cd-f2c4372e53f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cae0f37-1c48-43e7-94cd-f2c4372e53f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f86a6c-30bc-433b-a81f-023ce44fed3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2f86a6c-30bc-433b-a81f-023ce44fed3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad38710a-c39f-4544-b12f-8485cc69c96d', 'volume_name': 'volume-ad38710a-c39f-4544-b12f-8485cc69c96d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7100cd9-3d53-4868-93d8-257b4c2ce10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7100cd9-3d53-4868-93d8-257b4c2ce10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab01c7e-a5e8-4ebd-a416-7f3b6976ff32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:33 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Volume ad38710a-c39f-4544-b12f-8485cc69c96d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad38710a-c39f-4544-b12f-8485cc69c96d', 'volume_size': 1} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-253352362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad38710a-c39f-4544-b12f-8485cc69c96d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9598f9185b5c407fa3e0a5d709364eda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:33Z,use_quota=True,user_id='f43eb50ee364464c8d64ad44981f09f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Creating volume ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:33 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:33 devstack sudo[107569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d 1073741824 Jul 07 09:35:33 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-a57725e9-de09-4fd1-a13d-882168664687-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-a57725e9-de09-4fd1-a13d-882168664687-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-a57725e9-de09-4fd1-a13d-882168664687" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-a57725e9-de09-4fd1-a13d-882168664687" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot a57725e9-de09-4fd1-a13d-882168664687 of volume 60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4495a4e-cd19-40e6-8992-a3e255cc23b7]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:33 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 Jul 07 09:35:33 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:33 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d 1073741824" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:33 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d Jul 07 09:35:33 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:34 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d8e1b27-048e-4e95-9ef8-98b8f2c6422b]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:34 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 Jul 07 09:35:34 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:34 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d" returned: 0 in 0.649s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.505s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ab01c7e-a5e8-4ebd-a416-7f3b6976ff32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad38710a-c39f-4544-b12f-8485cc69c96d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057ca92e-fc93-44d1-be41-5ce447bc8118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:34 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Volume volume-ad38710a-c39f-4544-b12f-8485cc69c96d (ad38710a-c39f-4544-b12f-8485cc69c96d): created successfully Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (057ca92e-fc93-44d1-be41-5ce447bc8118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Flow 'volume_create_manager' (ce043c05-544e-4a2b-bf0a-007a715d6f92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:34 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-aa4424c7-9cb9-4e74-ac7d-d5a5cba0d3d8 tempest-ProjectReaderTests-1538320467 None] Created volume successfully. Jul 07 09:35:34 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" returned: 0 in 0.763s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:34 devstack sudo[107587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 Jul 07 09:35:34 devstack sudo[107587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Creating offline snapshot 55477f17-e370-44a7-bda8-c6a4b45d74f8 of volume ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7043ba7-c4d2-4124-b7d0-54ae91761353]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:35 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d Jul 07 09:35:35 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:35 devstack sudo[107587]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687" returned: 0 in 0.735s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:35 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687 Jul 07 09:35:35 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:36 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d" returned: 0 in 0.757s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:36 devstack sudo[107599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 1G Jul 07 09:35:36 devstack sudo[107599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:36 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4.a57725e9-de09-4fd1-a13d-882168664687" returned: 0 in 0.655s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-a57725e9-de09-4fd1-a13d-882168664687" released by "_delete_snapshot" :: held 3.040s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" released by "delete_snapshot" :: held 3.072s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Created reservations ['5c9984da-b5e6-4371-951e-dd110f625f85', 'bbd42784-e996-4eb9-89cd-11eeda947d53', 'e129e020-7679-4cac-a8e2-f50b34efe56f', '51f9b9e8-304f-460b-a33e-507ec4a4355b'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7f4376df-8a15-472e-851c-195a4a01fab5 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-a57725e9-de09-4fd1-a13d-882168664687-delete_snapshot" released by "delete_snapshot" :: held 3.212s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:36 devstack sudo[107599]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 1G" returned: 0 in 0.805s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad38710a-c39f-4544-b12f-8485cc69c96d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:36 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad38710a-c39f-4544-b12f-8485cc69c96d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 Jul 07 09:35:36 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b3ed0-a26c-4ee5-b9e0-c365e947ad51]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:37 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad38710a-c39f-4544-b12f-8485cc69c96d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8" returned: 0 in 0.761s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:37 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 is being set with open permissions: ugo+rw Jul 07 09:35:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:37 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 Jul 07 09:35:37 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:37 devstack sudo[107611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 Jul 07 09:35:37 devstack sudo[107611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:38 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:38 devstack sudo[107611]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" returned: 0 in 0.751s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:38 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info Jul 07 09:35:38 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:38 devstack sudo[107621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4 Jul 07 09:35:38 devstack sudo[107621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:38 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info" returned: 0 in 0.665s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:38 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info is being set with open permissions: ugo+rw Jul 07 09:35:38 devstack sudo[107621]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" returned: 0 in 0.656s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:38 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info Jul 07 09:35:38 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4" released by "delete_volume" :: held 1.472s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Created reservations ['5a32bca4-51bf-4cf8-903d-472979293722', 'fe012ec1-b8de-4640-ae55-799a6de1b6aa', 'e4bf863b-bf1e-4944-9daf-e97c8b771281', '0df6213f-b809-46e1-b2bc-902ac2ad49a8'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:39 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:39 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:39 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.info" returned: 0 in 0.658s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.386s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-dc486e66-524c-4c8e-a143-b593fc788465 tempest-ProjectReaderTests-1538320467 None] Create snapshot completed successfully Jul 07 09:35:39 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.639s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:39 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:35:39 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fb3523ff-0a58-470b-87f0-af6b9ccda232 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-60f47ee0-79e9-4dc2-9f9d-d975eaaa0fc4-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (654304eb-bea5-4301-bc6b-58f95e5893b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ed5700-1bdd-4b5f-ac77-fc7e12508c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8ed5700-1bdd-4b5f-ac77-fc7e12508c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745910997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad448bd-a524-4d86-9397-c47178f6d607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:40Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f4d396-438d-44d8-a22a-03586bc73690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f4d396-438d-44d8-a22a-03586bc73690) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1c0f98-fe00-4716-bf60-c2182f293375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b1c0f98-fe00-4716-bf60-c2182f293375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad448bd-a524-4d86-9397-c47178f6d607', 'volume_name': 'volume-7ad448bd-a524-4d86-9397-c47178f6d607', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d776a3-c378-448b-b949-21f0afe17d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00d776a3-c378-448b-b949-21f0afe17d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92566835-c185-4722-af67-97ef2a1e6def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:40 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Volume 7ad448bd-a524-4d86-9397-c47178f6d607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad448bd-a524-4d86-9397-c47178f6d607', 'volume_size': 1} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-745910997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad448bd-a524-4d86-9397-c47178f6d607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:40Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Creating volume 7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:40 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:40 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 1073741824 Jul 07 09:35:40 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-55477f17-e370-44a7-bda8-c6a4b45d74f8-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-55477f17-e370-44a7-bda8-c6a4b45d74f8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-ad38710a-c39f-4544-b12f-8485cc69c96d" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-ad38710a-c39f-4544-b12f-8485cc69c96d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-55477f17-e370-44a7-bda8-c6a4b45d74f8" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-55477f17-e370-44a7-bda8-c6a4b45d74f8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Deleting offline snapshot 55477f17-e370-44a7-bda8-c6a4b45d74f8 of volume ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] snapshot_file for this snap is: volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2701d8ab-c21d-4c2a-9909-d71d2da23034]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:40 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:40 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 Jul 07 09:35:40 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:41 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 1073741824" returned: 0 in 0.850s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:41 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 Jul 07 09:35:41 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:41 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8" returned: 0 in 0.820s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad38710a-c39f-4544-b12f-8485cc69c96d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[948c6c01-6d26-4cc3-87a4-8849fdfe263e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:41 devstack sudo[107643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d Jul 07 09:35:41 devstack sudo[107643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:41 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607" returned: 0 in 0.671s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1572ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92566835-c185-4722-af67-97ef2a1e6def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad448bd-a524-4d86-9397-c47178f6d607', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91381298-0bda-4642-87f3-8fec5b040d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Volume volume-7ad448bd-a524-4d86-9397-c47178f6d607 (7ad448bd-a524-4d86-9397-c47178f6d607): created successfully Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91381298-0bda-4642-87f3-8fec5b040d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (654304eb-bea5-4301-bc6b-58f95e5893b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:41 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d684e9d9-ebe7-4fab-9bf8-9b9bb594874f tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:35:42 devstack sudo[107643]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d" returned: 0 in 0.772s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:42 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 Jul 07 09:35:42 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot 8183aae9-82f3-4f46-8fae-439a122027f2 of volume 7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[268bc843-0e39-4c80-8823-8429ec30b09a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:42 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 Jul 07 09:35:42 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:42 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:43 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8 Jul 07 09:35:43 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:43 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607" returned: 0 in 0.801s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:43 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 1G Jul 07 09:35:43 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:43 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d.55477f17-e370-44a7-bda8-c6a4b45d74f8" returned: 0 in 0.678s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-55477f17-e370-44a7-bda8-c6a4b45d74f8" released by "_delete_snapshot" :: held 3.183s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-ad38710a-c39f-4544-b12f-8485cc69c96d" released by "delete_snapshot" :: held 3.207s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Created reservations ['72492083-6c92-4e40-a304-f74d1c2f19ca', 'f14f7ab9-b6ce-4b83-b8bd-c19a5470449a', 'a16b7fe3-dab0-4395-b020-512ad54f925b', 'b7af2282-fd94-4786-aac3-e703a8ef466a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Delete snapshot completed successfully. Jul 07 09:35:43 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-4ba81de1-512e-4168-83b5-29b5ab873959 tempest-ProjectReaderTests-1538320467 None] Lock "cinder-55477f17-e370-44a7-bda8-c6a4b45d74f8-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:43 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 1G" returned: 0 in 0.825s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad448bd-a524-4d86-9397-c47178f6d607 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:44 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad448bd-a524-4d86-9397-c47178f6d607 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 Jul 07 09:35:44 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:44 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad448bd-a524-4d86-9397-c47178f6d607 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2" returned: 0 in 0.666s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:44 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 is being set with open permissions: ugo+rw Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-ad38710a-c39f-4544-b12f-8485cc69c96d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:44 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 Jul 07 09:35:44 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Lock "cinder-ad38710a-c39f-4544-b12f-8485cc69c96d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Acquiring lock "cinder-quobyte-ad38710a-c39f-4544-b12f-8485cc69c96d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-ad38710a-c39f-4544-b12f-8485cc69c96d" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6259ae4e-fb5d-428d-8ef8-1e304e40ce25]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:44 devstack sudo[107676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d Jul 07 09:35:44 devstack sudo[107676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:45 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2" returned: 0 in 0.652s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:45 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info Jul 07 09:35:45 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:45 devstack sudo[107676]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d" returned: 0 in 0.811s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:45 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d Jul 07 09:35:45 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:46 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info" returned: 0 in 0.676s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:46 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info is being set with open permissions: ugo+rw Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:46 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info Jul 07 09:35:46 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:46 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-ad38710a-c39f-4544-b12f-8485cc69c96d" returned: 0 in 0.651s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Lock "cinder-quobyte-ad38710a-c39f-4544-b12f-8485cc69c96d" released by "delete_volume" :: held 1.518s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Created reservations ['5af70fe6-fd1c-4231-a31e-c767371b12ed', 'b6b422a3-903f-4581-83b8-94b0c194b6dd', '3c3dffb4-9ebf-4fce-81ce-7d48c9e40b7e', '5e0a8bb2-0115-4960-8e73-d384c1db1ddb'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:46 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:46 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:46 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.info" returned: 0 in 0.668s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.388s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-18f6dc37-27a5-417f-b31f-d46a178c1108 tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:35:47 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.662s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:47 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Deleted volume successfully. Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-5abd02f3-a0a0-4552-a336-a85b21120bad tempest-ProjectReaderTests-1538320467 None] Lock "cinder-ad38710a-c39f-4544-b12f-8485cc69c96d-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-8183aae9-82f3-4f46-8fae-439a122027f2-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-8183aae9-82f3-4f46-8fae-439a122027f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-7ad448bd-a524-4d86-9397-c47178f6d607" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-7ad448bd-a524-4d86-9397-c47178f6d607" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-8183aae9-82f3-4f46-8fae-439a122027f2" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-8183aae9-82f3-4f46-8fae-439a122027f2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot 8183aae9-82f3-4f46-8fae-439a122027f2 of volume 7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[40680b50-92a8-41a5-8ac5-3a6f6375486c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:47 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 Jul 07 09:35:47 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:48 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ad448bd-a524-4d86-9397-c47178f6d607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:35:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16bbbbf-4fe9-4db8-aadc-652b7ab9a082]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:48 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 Jul 07 09:35:48 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:49 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:49 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 Jul 07 09:35:49 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:50 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2" returned: 0 in 0.750s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:50 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2 Jul 07 09:35:50 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:50 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607.8183aae9-82f3-4f46-8fae-439a122027f2" returned: 0 in 0.655s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-8183aae9-82f3-4f46-8fae-439a122027f2" released by "_delete_snapshot" :: held 3.113s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-7ad448bd-a524-4d86-9397-c47178f6d607" released by "delete_snapshot" :: held 3.136s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Created reservations ['7eaf32ab-6812-4426-b3ba-ad50cc5bdda7', 'b66d6887-9cde-46ac-bd0d-9483d3fd94cd', '31ae48e0-fc1e-441e-aaf7-11b10f895b47', '530b0ba2-c454-4e13-8653-d95c8b69ace3'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:50 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:35:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-cb7826df-5b18-4c6d-880d-e1a047551856 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-8183aae9-82f3-4f46-8fae-439a122027f2-delete_snapshot" released by "delete_snapshot" :: held 3.261s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-7ad448bd-a524-4d86-9397-c47178f6d607-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-7ad448bd-a524-4d86-9397-c47178f6d607-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-7ad448bd-a524-4d86-9397-c47178f6d607" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:35:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-7ad448bd-a524-4d86-9397-c47178f6d607" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:35:51 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d64c6f-aede-401c-a302-68d4ba3cc8cc]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:52 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 Jul 07 09:35:52 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:52 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607" returned: 0 in 0.812s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:52 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:52 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607 Jul 07 09:35:52 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:53 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-7ad448bd-a524-4d86-9397-c47178f6d607" returned: 0 in 0.644s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-7ad448bd-a524-4d86-9397-c47178f6d607" released by "delete_volume" :: held 1.523s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Created reservations ['ef0510cd-7eaf-44f1-b1f4-1db5ebb264bc', '057fd535-24e2-4286-88b1-e55537b24481', '6e2ed826-d7e2-4b84-a743-78587b9bca01', '55384e73-1d9d-4823-8f0e-a4783faffe6d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:53 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:53 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:35:53 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:54 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.678s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:35:54 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a592fa28-607f-4e3f-9e12-2c8983fba570 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-7ad448bd-a524-4d86-9397-c47178f6d607-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (94f4cffe-b1c4-4c91-a75f-f6849e7f56eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679135c-7c9a-4645-ac94-db53cea8aece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f679135c-7c9a-4645-ac94-db53cea8aece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389931016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8503e5-6580-466a-be0b-9d110288d1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:54Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fc25e4-74de-4a72-b460-4096bcfa7b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87fc25e4-74de-4a72-b460-4096bcfa7b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff06b308-5059-486e-aab1-40df049dce81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff06b308-5059-486e-aab1-40df049dce81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8503e5-6580-466a-be0b-9d110288d1d6', 'volume_name': 'volume-2e8503e5-6580-466a-be0b-9d110288d1d6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af90cc13-11e4-4529-b9ea-e2cdfee9051a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af90cc13-11e4-4529-b9ea-e2cdfee9051a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84609d30-240a-49c4-9131-ce00ff636046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:54 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Volume 2e8503e5-6580-466a-be0b-9d110288d1d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8503e5-6580-466a-be0b-9d110288d1d6', 'volume_size': 1} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:35:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1389931016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e8503e5-6580-466a-be0b-9d110288d1d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:35:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:35:54Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Creating volume 2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:35:54 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:35:54 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:54 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 1073741824 Jul 07 09:35:54 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:55 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 1073741824" returned: 0 in 0.813s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:55 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:55 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 Jul 07 09:35:55 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:56 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6" returned: 0 in 0.679s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84609d30-240a-49c4-9131-ce00ff636046) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8503e5-6580-466a-be0b-9d110288d1d6', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e137d69-23a4-45e6-b330-04e2cebaae8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:35:56 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Volume volume-2e8503e5-6580-466a-be0b-9d110288d1d6 (2e8503e5-6580-466a-be0b-9d110288d1d6): created successfully Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e137d69-23a4-45e6-b330-04e2cebaae8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (94f4cffe-b1c4-4c91-a75f-f6849e7f56eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:35:56 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-6ac0263f-7ed3-4fec-b2c5-9744c2f6a14b tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot 1dee849c-e676-4322-a21a-4964f334ff04 of volume 2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d7daa-a5e0-4de6-82f1-b44fe623c301]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:35:56 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:56 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 Jul 07 09:35:56 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:57 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6" returned: 0 in 0.781s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:57 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:57 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 1G Jul 07 09:35:57 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:58 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 1G" returned: 0 in 0.838s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:58 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8503e5-6580-466a-be0b-9d110288d1d6 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:58 devstack sudo[107788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8503e5-6580-466a-be0b-9d110288d1d6 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 Jul 07 09:35:58 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:59 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8503e5-6580-466a-be0b-9d110288d1d6 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:59 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 is being set with open permissions: ugo+rw Jul 07 09:35:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:59 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 Jul 07 09:35:59 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:35:59 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 07 09:35:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04" returned: 0 in 0.630s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:35:59 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:35:59 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info Jul 07 09:35:59 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:00 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info" returned: 0 in 0.633s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:00 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info is being set with open permissions: ugo+rw Jul 07 09:36:00 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:00 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info Jul 07 09:36:00 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:01 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.info" returned: 0 in 0.669s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.333s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:01 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-34537dd2-98df-4b83-b256-1c7d415bee08 tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-1dee849c-e676-4322-a21a-4964f334ff04-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-1dee849c-e676-4322-a21a-4964f334ff04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-2e8503e5-6580-466a-be0b-9d110288d1d6" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-2e8503e5-6580-466a-be0b-9d110288d1d6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:01 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-1dee849c-e676-4322-a21a-4964f334ff04" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-1dee849c-e676-4322-a21a-4964f334ff04" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot 1dee849c-e676-4322-a21a-4964f334ff04 of volume 2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb843f71-4985-4c60-981b-f63def53494f]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:02 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 Jul 07 09:36:02 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:02 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04" returned: 0 in 0.779s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e8503e5-6580-466a-be0b-9d110288d1d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59187ef-f965-47db-a2e1-db71d4a64d28]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:02 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:02 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 Jul 07 09:36:02 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:03 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6" returned: 0 in 0.809s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:03 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:03 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 Jul 07 09:36:03 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:04 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04" returned: 0 in 0.771s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:04 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:04 devstack sudo[107818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04 Jul 07 09:36:04 devstack sudo[107818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:05 devstack sudo[107818]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:05 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6.1dee849c-e676-4322-a21a-4964f334ff04" returned: 0 in 0.662s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-1dee849c-e676-4322-a21a-4964f334ff04" released by "_delete_snapshot" :: held 3.116s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-2e8503e5-6580-466a-be0b-9d110288d1d6" released by "delete_snapshot" :: held 3.137s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:05 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Created reservations ['97b9587c-0527-4fd6-bba4-773ce004e1c7', 'b3310941-f5b9-498e-a085-815b8b67c2e7', 'ae54b73c-d365-477a-bcf5-44a3f05c9abb', 'ccec2828-d263-473b-bbc6-ed6ab114de9f'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:05 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:36:05 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-1517269e-ab9a-4fc6-a011-194c4b248e95 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-1dee849c-e676-4322-a21a-4964f334ff04-delete_snapshot" released by "delete_snapshot" :: held 3.275s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-2e8503e5-6580-466a-be0b-9d110288d1d6-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-2e8503e5-6580-466a-be0b-9d110288d1d6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-2e8503e5-6580-466a-be0b-9d110288d1d6" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:06 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-2e8503e5-6580-466a-be0b-9d110288d1d6" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:06 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[26491456-2c31-4545-9119-89698d991592]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:06 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:06 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 Jul 07 09:36:06 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:07 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6" returned: 0 in 0.761s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:07 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6 Jul 07 09:36:07 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:07 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-2e8503e5-6580-466a-be0b-9d110288d1d6" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-2e8503e5-6580-466a-be0b-9d110288d1d6" released by "delete_volume" :: held 1.481s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Created reservations ['b7266ca1-3ff5-4279-8cf3-337456d2a8d1', '71263df9-c364-4825-9d67-2782020579d1', 'a4ff3902-eb07-4c16-8ac4-434333276158', '2911dd3b-c2d6-4205-8986-830587ef0199'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:07 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:07 devstack sudo[107832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:07 devstack sudo[107832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:08 devstack sudo[107832]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:08 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.666s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:08 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:08 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:36:08 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-01073765-42f4-4f11-a961-9dac90a3dd6c tempest-ProjectMemberTests-1478510747 None] Lock "cinder-2e8503e5-6580-466a-be0b-9d110288d1d6-delete_volume" released by "delete_volume" :: held 2.411s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:08 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (3c34aba5-01de-41b3-810c-afc2f0fc506c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:08 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c296e7-0020-4df3-8412-4a549cf0707b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1c296e7-0020-4df3-8412-4a549cf0707b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336979726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776f7469-f3e6-4dde-b775-2d92ead44bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:09Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefc9386-05c8-4d57-89e2-2ecc445cd7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eefc9386-05c8-4d57-89e2-2ecc445cd7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666e562e-0e31-4863-9af5-39601310afce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (666e562e-0e31-4863-9af5-39601310afce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '776f7469-f3e6-4dde-b775-2d92ead44bb9', 'volume_name': 'volume-776f7469-f3e6-4dde-b775-2d92ead44bb9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a53e8-a68a-443e-acf5-e76c47fce625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260a53e8-a68a-443e-acf5-e76c47fce625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ef4a82-caa5-4cf3-9f80-6337c5698543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:09 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Volume 776f7469-f3e6-4dde-b775-2d92ead44bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-776f7469-f3e6-4dde-b775-2d92ead44bb9', 'volume_size': 1} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336979726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=776f7469-f3e6-4dde-b775-2d92ead44bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:09Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Creating volume 776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:09 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:09 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 1073741824 Jul 07 09:36:09 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:09 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 1073741824" returned: 0 in 0.829s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=99,cinder:INSERT=36,cinder:UPDATE=141,cinder:DELETE=11 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:36:09 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:09 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 Jul 07 09:36:09 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:10 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9" returned: 0 in 0.665s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:INSERT=37,cinder:UPDATE=123,cinder:SELECT=101,cinder:DELETE=10 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ef4a82-caa5-4cf3-9f80-6337c5698543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-776f7469-f3e6-4dde-b775-2d92ead44bb9', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3135a2ec-a483-46ac-a641-56b0086abfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:10 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Volume volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 (776f7469-f3e6-4dde-b775-2d92ead44bb9): created successfully Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3135a2ec-a483-46ac-a641-56b0086abfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (3c34aba5-01de-41b3-810c-afc2f0fc506c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:10 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-8ef9d251-f4b4-4fdf-b12d-cece2becd060 tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (3fe8cff7-b808-4330-ab99-870d68555a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d9ce2f-785a-4d7c-80ce-7fe3a0fc86ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2d9ce2f-785a-4d7c-80ce-7fe3a0fc86ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272547846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9eabe73-3753-447c-b407-ed56d70bd600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:11Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1939ec8c-9218-4ed1-b031-021c8581355e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1939ec8c-9218-4ed1-b031-021c8581355e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8836c2-d9ca-414b-8583-cc71707ac97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b8836c2-d9ca-414b-8583-cc71707ac97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9eabe73-3753-447c-b407-ed56d70bd600', 'volume_name': 'volume-b9eabe73-3753-447c-b407-ed56d70bd600', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccba935b-9b5e-4c4b-bf38-ae9e6ac738b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccba935b-9b5e-4c4b-bf38-ae9e6ac738b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83eed23c-a5c3-46ad-95d7-11c0c0fafa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:10 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Volume b9eabe73-3753-447c-b407-ed56d70bd600: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9eabe73-3753-447c-b407-ed56d70bd600', 'volume_size': 1} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-272547846',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9eabe73-3753-447c-b407-ed56d70bd600,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:11Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Creating volume b9eabe73-3753-447c-b407-ed56d70bd600 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:10 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:10 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:10 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 1073741824 Jul 07 09:36:10 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:11 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 1073741824" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:11 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 Jul 07 09:36:11 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:12 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600" returned: 0 in 0.642s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] <== create_volume: return (1495ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.055s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83eed23c-a5c3-46ad-95d7-11c0c0fafa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9eabe73-3753-447c-b407-ed56d70bd600', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4343045-2617-40ce-a3bb-c99e195ad29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot a1fcb5fb-6b1f-42c7-996c-1833f695a344 of volume 776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:36:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Volume volume-b9eabe73-3753-447c-b407-ed56d70bd600 (b9eabe73-3753-447c-b407-ed56d70bd600): created successfully Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4343045-2617-40ce-a3bb-c99e195ad29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (3fe8cff7-b808-4330-ab99-870d68555a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cb0338-21af-4a02-ba29-2e02417369dd]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-bfd18bd8-f1ae-4d09-80e2-2d079dd2c036 tempest-ProjectReaderTests-1321662130 None] Created volume successfully. Jul 07 09:36:12 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 Jul 07 09:36:12 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-b9eabe73-3753-447c-b407-ed56d70bd600-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Lock "cinder-b9eabe73-3753-447c-b407-ed56d70bd600-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:12 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-quobyte-b9eabe73-3753-447c-b407-ed56d70bd600" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-b9eabe73-3753-447c-b407-ed56d70bd600" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6434d68a-73ab-4f26-9920-0ebce44253a4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:13 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:13 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 1G Jul 07 09:36:13 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:13 devstack sudo[107858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 Jul 07 09:36:13 devstack sudo[107858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:13 devstack sudo[107858]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600" returned: 0 in 0.796s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:13 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600 Jul 07 09:36:13 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:13 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 1G" returned: 0 in 0.789s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:13 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 Jul 07 09:36:13 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:14 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-b9eabe73-3753-447c-b407-ed56d70bd600" returned: 0 in 0.667s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-b9eabe73-3753-447c-b407-ed56d70bd600" released by "delete_volume" :: held 1.510s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Created reservations ['37640429-eb53-43d7-b521-57032b099d93', 'd935be75-429d-4df5-ad81-2490908aa244', 'f0658cc7-dc28-49b5-896b-b693e374d99c', '841f156b-77a9-448e-9034-5c34b1a16247'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:14 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344" returned: 0 in 0.674s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:14 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 is being set with open permissions: ugo+rw Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:14 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 Jul 07 09:36:14 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:14 devstack sudo[107878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:14 devstack sudo[107878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:15 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344" returned: 0 in 0.670s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:15 devstack sudo[107878]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:15 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Deleted volume successfully. Jul 07 09:36:15 devstack sudo[107882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info Jul 07 09:36:15 devstack sudo[107882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-947549ba-23e9-4ecb-ac65-1722934e6a3b tempest-ProjectReaderTests-1321662130 None] Lock "cinder-b9eabe73-3753-447c-b407-ed56d70bd600-delete_volume" released by "delete_volume" :: held 2.384s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (b1c572de-dc49-4e41-9c10-f58d9b013fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3b76ba-09ae-4e5e-87ae-bc363ea8309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3b76ba-09ae-4e5e-87ae-bc363ea8309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547126554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61531ce-7a3e-48f8-b0c5-e047972bbd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:16Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb606d58-575d-4a90-b5d2-35e82d7555cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb606d58-575d-4a90-b5d2-35e82d7555cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8122744e-9876-4fc4-875d-914b2587b218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8122744e-9876-4fc4-875d-914b2587b218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61531ce-7a3e-48f8-b0c5-e047972bbd88', 'volume_name': 'volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d7e25a-6e6d-4038-a96c-8e202ff8f93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06d7e25a-6e6d-4038-a96c-8e202ff8f93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5180d73-7871-4221-a421-47032eec46ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:15 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Volume e61531ce-7a3e-48f8-b0c5-e047972bbd88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88', 'volume_size': 1} Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:15 devstack sudo[107882]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info" returned: 0 in 0.688s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:15 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info is being set with open permissions: ugo+rw Jul 07 09:36:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:15 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info Jul 07 09:36:15 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:16 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.info" returned: 0 in 0.622s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.333s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-547126554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61531ce-7a3e-48f8-b0c5-e047972bbd88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:16Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Creating volume e61531ce-7a3e-48f8-b0c5-e047972bbd88 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:16 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:16 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 1073741824 Jul 07 09:36:16 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:16 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-029a2652-f950-46bf-a1a2-0d952c909ae0 tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:36:17 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 1073741824" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:17 devstack sudo[107893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 Jul 07 09:36:17 devstack sudo[107893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-a1fcb5fb-6b1f-42c7-996c-1833f695a344-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-a1fcb5fb-6b1f-42c7-996c-1833f695a344-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-776f7469-f3e6-4dde-b775-2d92ead44bb9" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-776f7469-f3e6-4dde-b775-2d92ead44bb9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-a1fcb5fb-6b1f-42c7-996c-1833f695a344" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-a1fcb5fb-6b1f-42c7-996c-1833f695a344" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot a1fcb5fb-6b1f-42c7-996c-1833f695a344 of volume 776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[679ed02b-d30d-46bd-b0c3-6686a2716bfb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:17 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 Jul 07 09:36:17 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:18 devstack sudo[107893]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88" returned: 0 in 0.666s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5180d73-7871-4221-a421-47032eec46ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfc9d34-7403-47be-b721-5924f109104d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:18 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Volume volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 (e61531ce-7a3e-48f8-b0c5-e047972bbd88): created successfully Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddfc9d34-7403-47be-b721-5924f109104d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (b1c572de-dc49-4e41-9c10-f58d9b013fff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:18 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-60c2c3c0-57f8-4939-8e3a-d57092dfc8ee tempest-ProjectReaderTests-1321662130 None] Created volume successfully. Jul 07 09:36:18 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344" returned: 0 in 0.769s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-776f7469-f3e6-4dde-b775-2d92ead44bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[62201b0b-804b-4fdf-b561-3720fd6827ee]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:18 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 Jul 07 09:36:18 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-e61531ce-7a3e-48f8-b0c5-e047972bbd88-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Lock "cinder-e61531ce-7a3e-48f8-b0c5-e047972bbd88-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-quobyte-e61531ce-7a3e-48f8-b0c5-e047972bbd88" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-e61531ce-7a3e-48f8-b0c5-e047972bbd88" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde8b571-d52e-4432-84d4-b155041d9edb]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:18 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:19 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 Jul 07 09:36:19 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:19 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9" returned: 0 in 0.778s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:19 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 Jul 07 09:36:19 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:19 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88" returned: 0 in 0.782s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:19 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88 Jul 07 09:36:19 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:19 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344" returned: 0 in 0.738s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:19 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344 Jul 07 09:36:19 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:20 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-e61531ce-7a3e-48f8-b0c5-e047972bbd88" returned: 0 in 0.651s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-e61531ce-7a3e-48f8-b0c5-e047972bbd88" released by "delete_volume" :: held 1.486s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Created reservations ['41b33950-98f5-408e-9715-0676989c7bef', '03fb470c-8745-4521-b0b5-5f0386b66236', '18dc1819-bc68-49de-af66-c3753ed05b38', '937466d6-7b0f-4e5b-859d-32f3f9dfab65'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:20 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9.a1fcb5fb-6b1f-42c7-996c-1833f695a344" returned: 0 in 0.673s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:20 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:20 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-a1fcb5fb-6b1f-42c7-996c-1833f695a344" released by "_delete_snapshot" :: held 3.046s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-776f7469-f3e6-4dde-b775-2d92ead44bb9" released by "delete_snapshot" :: held 3.070s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Created reservations ['254b34df-d6fe-4c76-ba93-b14919fb9365', '5237a2f8-27e2-4f04-8ec4-0056ffe01a8b', 'f0c499f7-dcbe-4f3c-9314-1cb0bb7096d9', '5d3f0e5a-2870-4df2-901d-0c86aae2dc95'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:20 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:36:20 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-242a440d-7d99-44d7-9670-ddfe3ecd77b8 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-a1fcb5fb-6b1f-42c7-996c-1833f695a344-delete_snapshot" released by "delete_snapshot" :: held 3.214s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:21 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.638s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:21 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Deleted volume successfully. Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-42045427-a8fb-4bf5-b09c-61aca0865dd3 tempest-ProjectReaderTests-1321662130 None] Lock "cinder-e61531ce-7a3e-48f8-b0c5-e047972bbd88-delete_volume" released by "delete_volume" :: held 2.346s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (90d36bb1-7873-46f2-980a-517c8221eb86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809c8f9f-c53f-4b9c-90d7-a063b4ce74fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (809c8f9f-c53f-4b9c-90d7-a063b4ce74fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084093500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a800d156-dc07-44cf-a6b8-df675da6fe62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:21Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f1a3ec-945e-4372-94cf-6ad828d3a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06f1a3ec-945e-4372-94cf-6ad828d3a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b3d9e1-241f-4be0-bf4a-a7bd608192e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30b3d9e1-241f-4be0-bf4a-a7bd608192e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a800d156-dc07-44cf-a6b8-df675da6fe62', 'volume_name': 'volume-a800d156-dc07-44cf-a6b8-df675da6fe62', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bc4a1e-7443-4250-be58-1afbe0af7358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bc4a1e-7443-4250-be58-1afbe0af7358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579b938e-7b80-4072-8c55-eaa8a3d7e7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:21 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Volume a800d156-dc07-44cf-a6b8-df675da6fe62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a800d156-dc07-44cf-a6b8-df675da6fe62', 'volume_size': 1} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2084093500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a800d156-dc07-44cf-a6b8-df675da6fe62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:21Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Creating volume a800d156-dc07-44cf-a6b8-df675da6fe62 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:21 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:21 devstack sudo[107929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 1073741824 Jul 07 09:36:21 devstack sudo[107929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-776f7469-f3e6-4dde-b775-2d92ead44bb9-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-776f7469-f3e6-4dde-b775-2d92ead44bb9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-776f7469-f3e6-4dde-b775-2d92ead44bb9" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-776f7469-f3e6-4dde-b775-2d92ead44bb9" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b69ee-c7e4-4cd0-b736-8e02b2a568ea]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:21 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 Jul 07 09:36:21 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:22 devstack sudo[107929]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 1073741824" returned: 0 in 0.792s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:22 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 Jul 07 09:36:22 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:22 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9" returned: 0 in 0.782s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:22 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:22 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9 Jul 07 09:36:22 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:23 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62" returned: 0 in 0.695s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579b938e-7b80-4072-8c55-eaa8a3d7e7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a800d156-dc07-44cf-a6b8-df675da6fe62', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681f7acc-c7a5-4cbb-b25d-62d4b447a2a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:23 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Volume volume-a800d156-dc07-44cf-a6b8-df675da6fe62 (a800d156-dc07-44cf-a6b8-df675da6fe62): created successfully Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (681f7acc-c7a5-4cbb-b25d-62d4b447a2a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (90d36bb1-7873-46f2-980a-517c8221eb86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:23 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-c0392fbc-6a7d-4a0b-8527-b283096e53a8 tempest-ProjectReaderTests-1321662130 None] Created volume successfully. Jul 07 09:36:23 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-776f7469-f3e6-4dde-b775-2d92ead44bb9" returned: 0 in 0.657s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-776f7469-f3e6-4dde-b775-2d92ead44bb9" released by "delete_volume" :: held 1.490s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Created reservations ['610d537f-9fd3-435b-9710-7097c86688be', 'cf63d0ad-0b73-4acb-920e-0f8f6532b9b3', 'd6f03989-bc8b-451c-ae36-5377ef9b8ddd', '30de028b-1da3-48ae-9c20-3ef1003efd6d'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:23 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:23 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-a800d156-dc07-44cf-a6b8-df675da6fe62-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Lock "cinder-a800d156-dc07-44cf-a6b8-df675da6fe62-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-quobyte-a800d156-dc07-44cf-a6b8-df675da6fe62" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-a800d156-dc07-44cf-a6b8-df675da6fe62" acquired by "delete_volume" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[44deff7c-936f-4af9-9c63-cfdb8f90895d]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:23 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:23 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 Jul 07 09:36:23 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:24 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.693s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:24 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-131f49fd-4f76-41b5-9cb8-e11b4952ad40 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-776f7469-f3e6-4dde-b775-2d92ead44bb9-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (bf8b2ca9-86fd-4e46-92ce-7b93cb48a398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3eae19-3ef6-4857-9ca6-00fd22c58665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:24 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3eae19-3ef6-4857-9ca6-00fd22c58665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078198522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de3b70-4278-4d61-ae4f-8cae19aefa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:24Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d8355-841e-4214-aed3-d5b3850af312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411d8355-841e-4214-aed3-d5b3850af312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d81d47-09f9-4b52-a69d-4c80e5cf47b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1d81d47-09f9-4b52-a69d-4c80e5cf47b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88de3b70-4278-4d61-ae4f-8cae19aefa5d', 'volume_name': 'volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85595e0d-58b5-4321-b243-25f375943d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85595e0d-58b5-4321-b243-25f375943d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67638cf-13a8-4738-90df-a0d0e97673bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:24 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Volume 88de3b70-4278-4d61-ae4f-8cae19aefa5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d', 'volume_size': 1} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1078198522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88de3b70-4278-4d61-ae4f-8cae19aefa5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5d5bfcd506542dcab4e7b925dda0cbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:24Z,use_quota=True,user_id='0c9bfc0bae7c40118df32ceed5f70ea9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Creating volume 88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:24 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62" returned: 0 in 0.820s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:24 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:24 devstack sudo[107954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d 1073741824 Jul 07 09:36:24 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:24 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62 Jul 07 09:36:24 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:25 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a800d156-dc07-44cf-a6b8-df675da6fe62" returned: 0 in 0.665s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-a800d156-dc07-44cf-a6b8-df675da6fe62" released by "delete_volume" :: held 1.532s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Created reservations ['93849d1d-2ce3-435b-b0bb-e4eec69fc612', 'c4a3a749-7eb9-4405-8bf7-5b5bf0d73876', '9785523b-7a8c-437d-8ba8-932da16a9b22', '225ca033-12ef-4437-a7ae-824884709efd'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:25 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d 1073741824" returned: 0 in 0.821s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:25 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:25 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:25 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d Jul 07 09:36:25 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:26 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.672s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Deleted volume successfully. Jul 07 09:36:26 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d" returned: 0 in 0.648s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-02196add-aeac-45f3-8afd-cf0fc0b3ab7a tempest-ProjectReaderTests-1321662130 None] Lock "cinder-a800d156-dc07-44cf-a6b8-df675da6fe62-delete_volume" released by "delete_volume" :: held 2.413s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d67638cf-13a8-4738-90df-a0d0e97673bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81008f3-961c-4ffd-876f-f5b8baa4b6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:26 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Volume volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d (88de3b70-4278-4d61-ae4f-8cae19aefa5d): created successfully Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c81008f3-961c-4ffd-876f-f5b8baa4b6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Flow 'volume_create_manager' (bf8b2ca9-86fd-4e46-92ce-7b93cb48a398) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:26 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d86aff79-1ed4-48de-9574-f4dddadce58a tempest-ProjectMemberTests-1478510747 None] Created volume successfully. Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (23f51c57-4cef-4c17-a2c2-528c71bba3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624e084c-d200-499f-a0ba-ee4372fa9447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (624e084c-d200-499f-a0ba-ee4372fa9447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313137751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a636741-9a8a-4afa-b8aa-10ffacff1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:26Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9f9c7f-0448-4e92-ba89-0924e67319e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9f9c7f-0448-4e92-ba89-0924e67319e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74cc29e-b905-46b8-8511-d4a99b64a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74cc29e-b905-46b8-8511-d4a99b64a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a636741-9a8a-4afa-b8aa-10ffacff1458', 'volume_name': 'volume-0a636741-9a8a-4afa-b8aa-10ffacff1458', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b017977e-5863-49b2-9e35-7b99188c8b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b017977e-5863-49b2-9e35-7b99188c8b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3c2bb8-9ae0-4764-8f7f-16335a45f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:26 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Volume 0a636741-9a8a-4afa-b8aa-10ffacff1458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a636741-9a8a-4afa-b8aa-10ffacff1458', 'volume_size': 1} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-313137751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a636741-9a8a-4afa-b8aa-10ffacff1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5175b46226434c8040ce0de7685f62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:26Z,use_quota=True,user_id='58a97f4cbcca40deb7bef0c8479609a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Creating volume 0a636741-9a8a-4afa-b8aa-10ffacff1458 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:26 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:26 devstack sudo[107968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 1073741824 Jul 07 09:36:26 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:26 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:26 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:27 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 1073741824" returned: 0 in 0.825s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:27 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 Jul 07 09:36:27 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:27 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.645s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:36:27 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458" returned: 0 in 0.650s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] <== create_volume: return (1517ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.519s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.290s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b3c2bb8-9ae0-4764-8f7f-16335a45f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a636741-9a8a-4afa-b8aa-10ffacff1458', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cbb361-83d4-4756-ad65-ca25e5529425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:27 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Creating offline snapshot acb4dd6b-1bf3-4411-9d99-1403e097ca81 of volume 88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:36:28 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Volume volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 (0a636741-9a8a-4afa-b8aa-10ffacff1458): created successfully Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cbb361-83d4-4756-ad65-ca25e5529425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Flow 'volume_create_manager' (23f51c57-4cef-4c17-a2c2-528c71bba3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd165377-2173-48bb-ab13-fd243b4f36e4]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:28 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-41450778-8a41-4d2f-bc39-082ac7664d22 tempest-ProjectReaderTests-1321662130 None] Created volume successfully. Jul 07 09:36:28 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d Jul 07 09:36:28 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-0a636741-9a8a-4afa-b8aa-10ffacff1458-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Lock "cinder-0a636741-9a8a-4afa-b8aa-10ffacff1458-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Acquiring lock "cinder-quobyte-0a636741-9a8a-4afa-b8aa-10ffacff1458" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-0a636741-9a8a-4afa-b8aa-10ffacff1458" acquired by "delete_volume" :: waited 0.023s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62fe669-b5b5-4ffd-a875-bdcbf71f040c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:28 devstack sudo[107981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 Jul 07 09:36:28 devstack sudo[107981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:28 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d" returned: 0 in 0.783s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:28 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 1G Jul 07 09:36:28 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:29 devstack sudo[107981]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458" returned: 0 in 0.797s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:29 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458 Jul 07 09:36:29 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:29 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 1G" returned: 0 in 0.853s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:29 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 Jul 07 09:36:29 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:30 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-0a636741-9a8a-4afa-b8aa-10ffacff1458" returned: 0 in 0.653s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Lock "cinder-quobyte-0a636741-9a8a-4afa-b8aa-10ffacff1458" released by "delete_volume" :: held 1.506s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Created reservations ['03e7a7c1-5be0-4732-8755-29902f8b3020', '72f59d70-c1c8-4c53-a496-62478814b001', '267a00b8-98d5-4cb1-b429-7abe7992c8bf', '642ab7e8-d07a-4f60-8e9e-0a68ee793f4a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:30 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:30 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:30 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81" returned: 0 in 0.699s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:30 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 is being set with open permissions: ugo+rw Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:30 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 Jul 07 09:36:30 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:30 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.668s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:30 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Deleted volume successfully. Jul 07 09:36:30 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-7983ad07-0d1d-4268-a288-02922b8930aa tempest-ProjectReaderTests-1321662130 None] Lock "cinder-0a636741-9a8a-4afa-b8aa-10ffacff1458-delete_volume" released by "delete_volume" :: held 2.404s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:31 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81" returned: 0 in 0.674s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:31 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info Jul 07 09:36:31 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:31 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info" returned: 0 in 0.669s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:31 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info is being set with open permissions: ugo+rw Jul 07 09:36:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:31 devstack sudo[108011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info Jul 07 09:36:31 devstack sudo[108011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:32 devstack sudo[108011]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.info" returned: 0 in 0.701s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.504s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:32 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-303a79a4-73b9-41b2-9ed4-1f92bbcbbd24 tempest-ProjectMemberTests-1478510747 None] Create snapshot completed successfully Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-acb4dd6b-1bf3-4411-9d99-1403e097ca81-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-acb4dd6b-1bf3-4411-9d99-1403e097ca81-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-88de3b70-4278-4d61-ae4f-8cae19aefa5d" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-88de3b70-4278-4d61-ae4f-8cae19aefa5d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-acb4dd6b-1bf3-4411-9d99-1403e097ca81" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-acb4dd6b-1bf3-4411-9d99-1403e097ca81" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Deleting offline snapshot acb4dd6b-1bf3-4411-9d99-1403e097ca81 of volume 88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] snapshot_file for this snap is: volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80dff5c-ec90-4533-a8f7-182fe3f411ef]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:33 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 Jul 07 09:36:33 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:33 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81" returned: 0 in 0.733s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ff1d92-e37c-4b02-9e0a-f6f8062d2a04]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:33 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d Jul 07 09:36:33 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:34 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d" returned: 0 in 0.729s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:34 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 Jul 07 09:36:34 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:35 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81" returned: 0 in 0.705s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:35 devstack sudo[108030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81 Jul 07 09:36:35 devstack sudo[108030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:35 devstack sudo[108030]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d.acb4dd6b-1bf3-4411-9d99-1403e097ca81" returned: 0 in 0.640s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-acb4dd6b-1bf3-4411-9d99-1403e097ca81" released by "_delete_snapshot" :: held 2.897s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-88de3b70-4278-4d61-ae4f-8cae19aefa5d" released by "delete_snapshot" :: held 2.917s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Created reservations ['045181f5-6168-4173-90f3-18b8f92cb621', 'ab43ef1b-8317-4a8b-bb93-a214566c3577', '9a0ca778-6a38-440d-a98a-2029755d4c01', 'f7ceb49b-6a9d-4cd9-877d-0342de4a0f68'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:36 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Delete snapshot completed successfully. Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-2310c645-2050-4cd1-b183-300b8310eae0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-acb4dd6b-1bf3-4411-9d99-1403e097ca81-delete_snapshot" released by "delete_snapshot" :: held 3.048s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-88de3b70-4278-4d61-ae4f-8cae19aefa5d-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-88de3b70-4278-4d61-ae4f-8cae19aefa5d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "cinder-quobyte-88de3b70-4278-4d61-ae4f-8cae19aefa5d" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-88de3b70-4278-4d61-ae4f-8cae19aefa5d" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e01a4d2-ea7f-41c6-bec7-7d0f80a7790a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:36 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:36 devstack sudo[108033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d Jul 07 09:36:36 devstack sudo[108033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:37 devstack sudo[108033]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d" returned: 0 in 0.761s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:37 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d Jul 07 09:36:37 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:37 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-88de3b70-4278-4d61-ae4f-8cae19aefa5d" returned: 0 in 0.661s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-quobyte-88de3b70-4278-4d61-ae4f-8cae19aefa5d" released by "delete_volume" :: held 1.475s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Created reservations ['7484c496-d0b4-4b60-a38c-dfaa65f95aa1', 'c1991234-43ff-4567-90ba-ceaff7612cec', 'e6fe4924-ddca-4297-afb3-43e83dd9b199', 'c9d9a7a9-4949-4981-ad0f-1203f787f076'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:37 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:37 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:37 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:38 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:38 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.656s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:38 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:38 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Deleted volume successfully. Jul 07 09:36:38 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-d42fd4a7-a988-4f48-8bad-ceaf682fc3f0 tempest-ProjectMemberTests-1478510747 None] Lock "cinder-88de3b70-4278-4d61-ae4f-8cae19aefa5d-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Flow 'volume_create_manager' (4e304270-eeb9-4c22-940e-be724fc5f84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ada30-4145-469c-a69a-2fa7f801665b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a1ada30-4145-469c-a69a-2fa7f801665b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188912421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8552f-00e2-44e0-8c67-3dabcd2dab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d636013bbf4cd4b9ad41df3f177adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:42Z,use_quota=True,user_id='2daf2b2dfb154a37a2bf89ba3ea24f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b282df53-64f6-406a-acd0-ec13503acaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b282df53-64f6-406a-acd0-ec13503acaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe62a3de-dd56-4478-8168-7e5bd0cc9309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe62a3de-dd56-4478-8168-7e5bd0cc9309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9d8552f-00e2-44e0-8c67-3dabcd2dab31', 'volume_name': 'volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c1768c-2d77-4af7-9deb-f1281f271b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6c1768c-2d77-4af7-9deb-f1281f271b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f2fc94-6e59-448f-871f-1b133ab4a0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:41 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Volume d9d8552f-00e2-44e0-8c67-3dabcd2dab31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31', 'volume_size': 1} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-188912421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9d8552f-00e2-44e0-8c67-3dabcd2dab31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d636013bbf4cd4b9ad41df3f177adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:42Z,use_quota=True,user_id='2daf2b2dfb154a37a2bf89ba3ea24f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Creating volume d9d8552f-00e2-44e0-8c67-3dabcd2dab31 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:41 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:41 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:42 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 1073741824 Jul 07 09:36:42 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:42 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 1073741824" returned: 0 in 0.814s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:42 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:42 devstack sudo[108051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 Jul 07 09:36:42 devstack sudo[108051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:43 devstack sudo[108051]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31" returned: 0 in 0.634s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8f2fc94-6e59-448f-871f-1b133ab4a0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0741ac69-2f82-4df3-a44b-e5b2d3a40f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:43 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Volume volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 (d9d8552f-00e2-44e0-8c67-3dabcd2dab31): created successfully Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0741ac69-2f82-4df3-a44b-e5b2d3a40f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:43 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Flow 'volume_create_manager' (4e304270-eeb9-4c22-940e-be724fc5f84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:43 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3fa1c529-a1d8-4f56-a5f0-569c1bc16819 tempest-ProjectReaderTests-610932216 None] Created volume successfully. Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Acquiring lock "cinder-d9d8552f-00e2-44e0-8c67-3dabcd2dab31-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Lock "cinder-d9d8552f-00e2-44e0-8c67-3dabcd2dab31-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Acquiring lock "cinder-quobyte-d9d8552f-00e2-44e0-8c67-3dabcd2dab31" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Lock "cinder-quobyte-d9d8552f-00e2-44e0-8c67-3dabcd2dab31" acquired by "delete_volume" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9b7f6d-f767-488a-b79d-8fd53e27353e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:44 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 Jul 07 09:36:44 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:44 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31" returned: 0 in 0.741s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:44 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:44 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31 Jul 07 09:36:44 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:45 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-d9d8552f-00e2-44e0-8c67-3dabcd2dab31" returned: 0 in 0.654s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Lock "cinder-quobyte-d9d8552f-00e2-44e0-8c67-3dabcd2dab31" released by "delete_volume" :: held 1.446s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Created reservations ['bff94283-002f-4f69-9e9f-1caf7c6dcf6a', 'd768fe5a-efa9-4bbb-a027-dacfc2fc7b54', '0d98f4c6-440a-40ce-b440-b7fcc5cb8c07', '839277c4-9808-47be-aacd-c103909e01b3'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:45 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:45 devstack sudo[108098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:45 devstack sudo[108098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:46 devstack sudo[108098]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.628s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:46 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Deleted volume successfully. Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-fe87e63e-f440-4c5d-a103-420186baaadd tempest-ProjectReaderTests-610932216 None] Lock "cinder-d9d8552f-00e2-44e0-8c67-3dabcd2dab31-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Flow 'volume_create_manager' (f94ba5ac-4db0-41f4-8f47-8590d51cb517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f608395-d1b7-4667-ba14-73f6f7aef457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f608395-d1b7-4667-ba14-73f6f7aef457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225509755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d53bc8-50f9-49c8-93eb-707e5c409c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d636013bbf4cd4b9ad41df3f177adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:47Z,use_quota=True,user_id='2daf2b2dfb154a37a2bf89ba3ea24f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7901a0ad-7537-4bbc-9a96-7b5ebeaa87c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7901a0ad-7537-4bbc-9a96-7b5ebeaa87c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac426441-ab10-4983-8b89-c86c82a89956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac426441-ab10-4983-8b89-c86c82a89956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d53bc8-50f9-49c8-93eb-707e5c409c53', 'volume_name': 'volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc44b28-2026-495b-aec8-5f72153ddfaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acc44b28-2026-495b-aec8-5f72153ddfaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7376d8c4-d96c-4912-8f88-e50f172325a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:46 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Volume a0d53bc8-50f9-49c8-93eb-707e5c409c53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53', 'volume_size': 1} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-225509755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d53bc8-50f9-49c8-93eb-707e5c409c53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6d636013bbf4cd4b9ad41df3f177adc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:36:47Z,use_quota=True,user_id='2daf2b2dfb154a37a2bf89ba3ea24f53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Creating volume a0d53bc8-50f9-49c8-93eb-707e5c409c53 {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:36:46 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:36:46 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:46 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 1073741824 Jul 07 09:36:46 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:47 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 1073741824" returned: 0 in 0.797s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:47 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:47 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 Jul 07 09:36:47 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:48 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53" returned: 0 in 0.632s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7376d8c4-d96c-4912-8f88-e50f172325a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8593e2-367b-45cc-81a7-d77276bfb83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:36:48 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Volume volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 (a0d53bc8-50f9-49c8-93eb-707e5c409c53): created successfully Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8593e2-367b-45cc-81a7-d77276bfb83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Flow 'volume_create_manager' (f94ba5ac-4db0-41f4-8f47-8590d51cb517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:36:48 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-fbbb8370-6ebc-4857-ae54-2f82563fde26 tempest-ProjectReaderTests-610932216 None] Created volume successfully. Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Acquiring lock "cinder-a0d53bc8-50f9-49c8-93eb-707e5c409c53-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Lock "cinder-a0d53bc8-50f9-49c8-93eb-707e5c409c53-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Acquiring lock "cinder-quobyte-a0d53bc8-50f9-49c8-93eb-707e5c409c53" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Lock "cinder-quobyte-a0d53bc8-50f9-49c8-93eb-707e5c409c53" acquired by "delete_volume" :: waited 0.018s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[59515e34-3ff3-4b7a-96ca-4e1d7e547b9e]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:36:48 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:49 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 Jul 07 09:36:49 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:49 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53" returned: 0 in 0.739s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:49 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:49 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53 Jul 07 09:36:49 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:50 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a0d53bc8-50f9-49c8-93eb-707e5c409c53" returned: 0 in 0.635s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Lock "cinder-quobyte-a0d53bc8-50f9-49c8-93eb-707e5c409c53" released by "delete_volume" :: held 1.409s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Created reservations ['7e1fbfd8-1533-49d5-961b-d5edddec7f69', 'f74b9429-02b6-4a81-bd8f-bbcf51ba41cc', 'a4225196-7f42-4a97-a594-af38d5ebff52', '28495bc5-88a1-4354-922c-84749e3151da'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:36:50 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:36:50 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:36:50 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:36:51 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Jul 07 09:36:51 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.648s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:36:51 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:36:51 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Deleted volume successfully. Jul 07 09:36:51 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-9c1fea89-a4fe-405a-83e5-93fb1efc2524 tempest-ProjectReaderTests-610932216 None] Lock "cinder-a0d53bc8-50f9-49c8-93eb-707e5c409c53-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:00 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=76,cinder:UPDATE=94,cinder:INSERT=24,cinder:DELETE=4 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:37:01 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:UPDATE=106,cinder:DELETE=14,cinder:SELECT=60,cinder:INSERT=25 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Flow 'volume_create_manager' (752afdc6-f065-49ca-b476-3121ca76ae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e479aa1e-4a15-4aa4-887b-aa5c0f36d186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e479aa1e-4a15-4aa4-887b-aa5c0f36d186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-744234687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0376c1d-a47f-4621-9e22-435709d90f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31915769edce4567981a906727f3e59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:37:11Z,use_quota=True,user_id='49d9d52e28814af4acd7a42f9c2de193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741690e7-232c-4b70-ac20-6375f4f96783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741690e7-232c-4b70-ac20-6375f4f96783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cbf761-ab33-41f8-932b-5a2597a4671e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cbf761-ab33-41f8-932b-5a2597a4671e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0376c1d-a47f-4621-9e22-435709d90f9f', 'volume_name': 'volume-f0376c1d-a47f-4621-9e22-435709d90f9f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ab2def-75dc-4870-9d89-f6da0a9b7c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82ab2def-75dc-4870-9d89-f6da0a9b7c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5010d9a-4f8c-4793-9450-f195937d04c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:11 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Volume f0376c1d-a47f-4621-9e22-435709d90f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0376c1d-a47f-4621-9e22-435709d90f9f', 'volume_size': 1} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:37:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-744234687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0376c1d-a47f-4621-9e22-435709d90f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31915769edce4567981a906727f3e59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:37:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:37:11Z,use_quota=True,user_id='49d9d52e28814af4acd7a42f9c2de193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)}" {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Creating volume f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:37:11 devstack cinder-volume[86769]: INFO cinder.volume.drivers.remotefs [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] casted to osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 Jul 07 09:37:11 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f 1073741824 {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:11 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f 1073741824 Jul 07 09:37:11 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:12 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f 1073741824" returned: 0 in 0.793s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:12 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:12 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:12 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.633s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'} {{(pid=86769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5010d9a-4f8c-4793-9450-f195937d04c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0376c1d-a47f-4621-9e22-435709d90f9f', 'volume_size': 1}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113d98be-813c-491b-ae44-45504c2c221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:12 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Volume volume-f0376c1d-a47f-4621-9e22-435709d90f9f (f0376c1d-a47f-4621-9e22-435709d90f9f): created successfully Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (113d98be-813c-491b-ae44-45504c2c221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:12 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Flow 'volume_create_manager' (752afdc6-f065-49ca-b476-3121ca76ae96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:37:12 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-4211abf8-c1e3-48e0-9e5b-70c0d60e058d tempest-SnapshotDependencyTests-768420704 None] Created volume successfully. Jul 07 09:37:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:13 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Creating offline snapshot ddeaf9b5-726b-442b-b8fd-35ec17bae9bd of volume f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 07 09:37:13 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd4e82b-5b84-48ac-87bc-42d2bb6cb895]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:13 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:13 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:13 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:14 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.745s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:14 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd 1G {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:14 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd 1G Jul 07 09:37:14 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:15 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd 1G" returned: 0 in 0.773s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0376c1d-a47f-4621-9e22-435709d90f9f -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:15 devstack sudo[108153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0376c1d-a47f-4621-9e22-435709d90f9f -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd Jul 07 09:37:15 devstack sudo[108153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:15 devstack sudo[108153]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0376c1d-a47f-4621-9e22-435709d90f9f -F qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" returned: 0 in 0.674s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:15 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd is being set with open permissions: ugo+rw Jul 07 09:37:15 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:15 devstack sudo[108158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd Jul 07 09:37:15 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:16 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" returned: 0 in 0.632s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:16 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:16 devstack sudo[108161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info Jul 07 09:37:16 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:17 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info" returned: 0 in 0.632s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:17 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info is being set with open permissions: ugo+rw Jul 07 09:37:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:17 devstack sudo[108164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info Jul 07 09:37:17 devstack sudo[108164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:17 devstack sudo[108164]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.info" returned: 0 in 0.627s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:17 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.166s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:17 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-97a25140-791e-4a17-91e6-6077b605038b tempest-SnapshotDependencyTests-768420704 None] Create snapshot completed successfully Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.flows.manager.create_volume [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Flow 'volume_create_manager' (1cd52ff2-d433-4d60-a019-d1e59cbf2a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fab1dfa-6dfd-4145-8bf9-ddcfd2fcca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fab1dfa-6dfd-4145-8bf9-ddcfd2fcca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T07:37:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a35e0690-9d6d-409f-a714-e2fa158bd5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31915769edce4567981a906727f3e59a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T07:37:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ddeaf9b5-726b-442b-b8fd-35ec17bae9bd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T07:37:19Z,use_quota=True,user_id='49d9d52e28814af4acd7a42f9c2de193',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(281b169d-61f0-4f73-9281-e7388f638a8d),volume_type_id=281b169d-61f0-4f73-9281-e7388f638a8d)' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c71c4-70bc-4106-901b-3b02638cc479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85c71c4-70bc-4106-901b-3b02638cc479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e235b9-06c1-4cc8-89ae-5163243d58b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e235b9-06c1-4cc8-89ae-5163243d58b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a35e0690-9d6d-409f-a714-e2fa158bd5ec', 'volume_name': 'volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec', 'volume_size': 1, 'snapshot_id': 'ddeaf9b5-726b-442b-b8fd-35ec17bae9bd'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3260390-c362-4e52-af70-f90483dc765d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3260390-c362-4e52-af70-f90483dc765d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf36d75-1a0d-40bc-a9eb-3252c0feb1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:19 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Volume a35e0690-9d6d-409f-a714-e2fa158bd5ec: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec', 'volume_size': 1, 'snapshot_id': 'ddeaf9b5-726b-442b-b8fd-35ec17bae9bd'} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-quobyte-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd-a35e0690-9d6d-409f-a714-e2fa158bd5ec" by "_create_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd-a35e0690-9d6d-409f-a714-e2fa158bd5ec" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Creating volume a35e0690-9d6d-409f-a714-e2fa158bd5ec from snapshot ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Selected osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68 as target Quobyte volume. {{(pid=86769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-quobyte-a35e0690-9d6d-409f-a714-e2fa158bd5ec" by "_copy_volume_from_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-a35e0690-9d6d-409f-a714-e2fa158bd5ec" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] snapshot: ddeaf9b5-726b-442b-b8fd-35ec17bae9bd, volume: a35e0690-9d6d-409f-a714-e2fa158bd5ec, {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e301c102-ec01-45d5-bdb0-99c6d8b178db]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:19 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:19 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd Jul 07 09:37:19 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:20 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" returned: 0 in 0.723s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0376c1d-a47f-4621-9e22-435709d90f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:37:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 07 09:37:20 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Creating direct copy from snapshot {{(pid=86769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 07 09:37:20 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6ce5fa-0d48-45ac-bd33-2bd952370b84]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:20 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:20 devstack sudo[108172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:20 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:21 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.736s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:21 devstack cinder-volume[86769]: DEBUG cinder.utils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Path /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec not found in is_blk_device check {{(pid=86769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 07 09:37:21 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:21 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec Jul 07 09:37:21 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:25 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec" returned: 0 in 4.325s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:25 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a0d704-f58a-42c8-9102-5ee122cc406a]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:25 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:25 devstack sudo[108191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:25 devstack sudo[108191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:26 devstack sudo[108191]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.934s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.image.image_utils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Image conversion details: src /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f, size 1024.00 MB, duration 4.33 sec, destination /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec {{(pid=86769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 07 09:37:26 devstack cinder-volume[86769]: INFO cinder.image.image_utils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Converted 1024.00 MB image at 236.67 MB/s Jul 07 09:37:26 devstack cinder-volume[86769]: WARNING cinder.volume.drivers.remotefs [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec is being set with open permissions: ugo+rw Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:26 devstack sudo[108196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec Jul 07 09:37:26 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:26 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec" returned: 0 in 0.635s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-a35e0690-9d6d-409f-a714-e2fa158bd5ec" released by "_copy_volume_from_snapshot" :: held 7.445s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd-a35e0690-9d6d-409f-a714-e2fa158bd5ec" released by "_create_volume_from_snapshot" :: held 7.472s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.486s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:26 devstack sudo[108199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:37:26 devstack sudo[108199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cf36d75-1a0d-40bc-a9eb-3252c0feb1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec', 'volume_size': 1, 'snapshot_id': 'ddeaf9b5-726b-442b-b8fd-35ec17bae9bd'}' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:26 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eadd167-cc92-42bf-b2c7-769f48abfcdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 07 09:37:27 devstack cinder-volume[86769]: INFO cinder.volume.flows.manager.create_volume [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Volume volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec (a35e0690-9d6d-409f-a714-e2fa158bd5ec): created successfully Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eadd167-cc92-42bf-b2c7-769f48abfcdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Flow 'volume_create_manager' (1cd52ff2-d433-4d60-a019-d1e59cbf2a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 07 09:37:27 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-954e5314-67f1-411c-a668-2188ce041223 tempest-SnapshotDependencyTests-768420704 None] Created volume successfully. Jul 07 09:37:27 devstack sudo[108199]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.655s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG oslo_service.periodic_task [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] Running periodic task VolumeManager._thread_info {{(pid=86769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread count: 28 {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5484}} Jul 07 09:37:27 devstack cinder-volume[86769]: DEBUG cinder.volume.manager [None req-650136c2-ab10-4b2e-b2a6-bfe858fb0740 None None] thread info: [<_MainThread(MainThread, started 124413414613120)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5485}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd-delete_snapshot" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-quobyte-f0376c1d-a47f-4621-9e22-435709d90f9f" by "delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-f0376c1d-a47f-4621-9e22-435709d90f9f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-quobyte-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" by "_delete_snapshot" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Deleting offline snapshot ddeaf9b5-726b-442b-b8fd-35ec17bae9bd of volume f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] snapshot_file for this snap is: volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1407b0-aa4d-4c9f-a851-baf93effd49c]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:28 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd Jul 07 09:37:28 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:28 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" returned: 0 in 0.729s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.remotefs [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0376c1d-a47f-4621-9e22-435709d90f9f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3228f797-9cec-48f5-808c-de3df6c35730]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:28 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:29 devstack sudo[108208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:29 devstack sudo[108208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:29 devstack sudo[108208]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.728s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:29 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:29 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd Jul 07 09:37:29 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:30 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" returned: 0 in 0.706s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:30 devstack sudo[108218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd Jul 07 09:37:30 devstack sudo[108218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:30 devstack sudo[108218]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:30 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f.ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" returned: 0 in 0.612s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd" released by "_delete_snapshot" :: held 2.870s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-f0376c1d-a47f-4621-9e22-435709d90f9f" released by "delete_snapshot" :: held 2.894s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Created reservations ['e11891fe-e39e-4a6a-92dc-3f2eb30ed8d2', 'f98ede96-f902-4f11-b93c-64a6bc7a9fcc', '47d62d6b-635d-4a32-924f-4382cab01a72', 'baf833eb-4915-4e5f-8547-6ec5e0d4f3e9'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:37:31 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Delete snapshot completed successfully. Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-52f51777-9221-4cbb-b06d-9f05196cf1d3 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-ddeaf9b5-726b-442b-b8fd-35ec17bae9bd-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-f0376c1d-a47f-4621-9e22-435709d90f9f-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-f0376c1d-a47f-4621-9e22-435709d90f9f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-quobyte-f0376c1d-a47f-4621-9e22-435709d90f9f" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-f0376c1d-a47f-4621-9e22-435709d90f9f" acquired by "delete_volume" :: waited 0.014s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[059ba5a3-22f6-4822-bff1-7fe2f84cb627]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:31 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:31 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:31 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:32 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.742s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:32 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f Jul 07 09:37:32 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:32 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-f0376c1d-a47f-4621-9e22-435709d90f9f" returned: 0 in 0.650s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-f0376c1d-a47f-4621-9e22-435709d90f9f" released by "delete_volume" :: held 1.447s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Created reservations ['17e04919-32e4-4316-b1ec-718b26d718a5', 'ff30d54e-4d01-4809-9c1f-fa7451203bee', 'a5ceb544-e9bd-43fb-ac2a-7a52bd784981', 'cc4fa06e-1243-4d24-9e55-6bf20d59ce7a'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:32 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:32 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:37:32 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-a35e0690-9d6d-409f-a714-e2fa158bd5ec-delete_volume" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-a35e0690-9d6d-409f-a714-e2fa158bd5ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "cinder-quobyte-a35e0690-9d6d-409f-a714-e2fa158bd5ec" by "delete_volume" {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 07 09:37:33 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.667s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:37:33 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Deleted volume successfully. Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-a35e0690-9d6d-409f-a714-e2fa158bd5ec" acquired by "delete_volume" :: waited 0.021s {{(pid=86769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04ac9dc-b626-4e2f-bf17-c0a2bb6cc4f9]: (4, 'qcow2') {{(pid=87929) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:33 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-a63129c1-10a3-4875-8682-c1fe919248a0 tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-f0376c1d-a47f-4621-9e22-435709d90f9f-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:33 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec Jul 07 09:37:33 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:34 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec" returned: 0 in 0.758s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:34 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec Jul 07 09:37:34 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:34 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:34 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b/volume-a35e0690-9d6d-409f-a714-e2fa158bd5ec" returned: 0 in 0.626s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-quobyte-a35e0690-9d6d-409f-a714-e2fa158bd5ec" released by "delete_volume" :: held 1.426s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG cinder.quota [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Created reservations ['a14ef8c4-f95d-46aa-a4b4-25abe54f1b0e', 'db9e8746-7a46-4ab4-8416-f50dff271b13', '12027ca6-fd14-4feb-9004-a15f9a77ac46', '31c11d3d-d37c-486e-ba96-14d2eb7ac33e'] {{(pid=86769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68': None} {{(pid=86769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG cinder.volume.drivers.quobyte [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-6ba38ba6-82ab-4ab0-8f7d-2423f8c48a68'] {{(pid=86769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.lockutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 07 09:37:35 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b Jul 07 09:37:35 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 07 09:37:35 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG oslo_concurrency.processutils [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1401cf60c6e51301eb08619c52a9203b" returned: 0 in 0.652s {{(pid=86769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG cinder.manager [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Notifying Schedulers of capabilities ... {{(pid=86769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 07 09:37:35 devstack cinder-volume[86769]: INFO cinder.volume.manager [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Deleted volume successfully. Jul 07 09:37:35 devstack cinder-volume[86769]: DEBUG cinder.coordination [None req-3b8dd8d5-eff1-4f0c-9a98-f4a0b6efabcd tempest-SnapshotDependencyTests-768420704 None] Lock "cinder-a35e0690-9d6d-409f-a714-e2fa158bd5ec-delete_volume" released by "delete_volume" :: held 2.275s {{(pid=86769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 07 09:37:45 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=26,cinder:UPDATE=24,cinder:DELETE=3,cinder:INSERT=6 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 07 09:37:45 devstack cinder-volume[86769]: DEBUG dbcounter [-] [86769] Writing DB stats cinder:SELECT=22,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=2 {{(pid=86769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}